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® Image signai coding and decoding and image signal recording medium. 
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iJ£ P rese , nt ' nvention reproduces an input 
mage of half the normal resolution with respect 
to the vertical and horizontal directions in high 
picture quality by processing a coded bit stream 
of a normal resolution. 

Difference signal, (mismatching error signal) 
representing the difference between a predic- 
ted image of the normal resolution and a predic- 
ted .mage of a half resolution with respect to the 
vertical and horizontal directions is coded and 
the coded difference signal is transmitted. 
When producing the predicted image, image 

rorL'f f SUbj6Cted J° motion compensation ac- 
cording to a specified prediction mode. 
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The present invention relates to an image signal 
coding method, an image signal decoding method, an 
image signal encoder, an image signal decoder and 
an image signal recording medium suitable for use for 
compressing, for example, High Definition Television 
signals (HDTV signals) and recording the com- 
pressed HDTV signals in a recording medium, such 
as an optical disk, magnetooptic disk or a magnetic 
tape, reproducing the recorded compressed HDTV 
signals, expanding the reproduced compressed 
HDTV signals to restore the normal range and dis- 
playing the restored HDTV signals. 

Fig. 27 shows a conventional image signal encod- 
er and a conventional image signal decoder by way of 
example. The image signal encoder includes a pre- 
processing circuit 1 which separates the luminance 
signal (Y signal) and the color difference signal (C sig- 
nal) of an input image signal, such as a HDTV signal. 
An A/D converter 2 converts the luminance signal into 
a corresponding digital luminance signal and stores 
the digital luminance signal temporarily in a frame 
memory 4. An A/D converter converts the color differ- 
ence signal into a corresponding digital color differ- 
ence signal and stores the digital color difference sig- 
nal temporarily in a frame memory 5. Aformat conver- 
sion circuit 6 converts the digital luminance signal and 
the digital color difference signal of a frame format 
stored in the frame memories 4 and 5 into corre- 
sponding luminance data and color difference data of 
a block format, and gives the luminance data and the 
color difference data of a block format to an encoder 
7. The encoder 7 encodes the input signals and gives 
a bit stream representing the coded input signals to a 
recording medium 8, such as an optical disk, a mag- 
netooptic disk or a magnetic tape for recording. 

A decoder 9 decodes the data reproduced from 
the recording medium 8 in a bit stream. Aformat con- 
version circuit 10 converts the decoded data of a 
block format provided by the decoder 9 into corre- 
sponding decoded of a frame format Luminance data 
and color difference data provided by the format con- 
version circuit 10 are stored respectively in frame 
memories 11 and 12. The luminance data and the col- 
or difference data read from the frame memories 11 
and 12 are converted into corresponding analog lumi- 
nance signal and analog color difference signal re- 
spectively by D/A converters 13 and 14. A post proc- 
essing circuit 1 5 composes the analog luminance sig- 
nal and the analog color difference signal to give an 
output image signal to an external circuit, not shown. 

The encoder 7 compresses the input image data 
and gives the compressed image data to the record- 
ing medium 8. The decoder expands the compressed 
input data and gives the expanded image data to the 
format conversion circuit 10. The quantity of the data 
to be recorded in the recording medium 8 can be re- 
duced by compression. The line correlation or inter- 
frame correlation of image signals is used for com- 



pression. 

When line correlation is used, the image signal 
can be compressed by, for example, DCT (Discrete 
Cosine Transformation). 
5 When interframe correlation is used, the image 

signal can be further compressed for coding. For ex- 
ample, suppose that frame pictures PC1, PC2 and 
PC3 are produced respectively at times t1, t2 and t3 
as shown in Fig. 28. The difference between image 
10 signals respectively representing the frame pictures 
PC1 and PC2 is calculated to produce a frame picture 
PC12, and the difference between the frame pictures 
PC2 and PC3 is calculated to produce a frame picture 
PC23. Since the difference between the successive 
r5 frame pictures, in general, is not very large, a differ- 
ence signal representing the difference between the 
successive frame pictures is small. The difference 
signal is coded to reduce the quantity of data. 

However, if only the difference signal is used, the 
20 original picture cannot be restored. Accordingly, one 
of an I picture, a P picture and a B picture is used as 
a frame picture to encode the image signal. 

For example, as shown in Fig. 29, a group of pic- 
tures including image signals representing frames F1 
25 to F17 is processed in a unit. The image signal repre- 
senting the head frame F1 is coded in an I picture, the 
image signal representing the second frame F2 is 
coded in a B picture and the image signal represent- 
ing the third frame F3 is coded in a P picture. The im- 
30 age signals representing the fourth frame F4 to the 
seventeenth frame F1 7 are coded alternately in B pic- 
tures and P pictures. 

The image signal representing the I picture is ob- 
tained by coding the image signal representing the 
35 corresponding frame. Basically, the image signal rep- 
resenting the P picture is obtained by coding the dif- 
ference between the image signal representing the 
corresponding frame and the image signal represent- 
ing the preceding I picture or P picture as shown in 
40 Fig. 29(A). The image signal representing the B pic- 
ture is obtained by coding the difference between the 
image signal representing the corresponding frame 
and the mean of of the image signals representing the 
preceding and succeeding frames. 
45 Fig. 30 is a diagrammatic view of assistance in ex- 

plaining the principle on which is based a method of 
coding a moving picture. As shown in Fig. 30, the first 
frame F1 is processed as an I picture to provide data 
F1X on a transmission line (interframe coding). The 
so second frame F2 is processed as a B picture, in which 
the difference between the second frame F2 and the 
means of the preceding frame F1 and the succeeding 
frame F3 is calculated, and then the difference is cod- 
ed to provide transmission data F2X.. 
55 The second frame F2 can be processed as a B 

picture in four processing modes. In a first processing 
mode, the data representing the frame F2 is coded to 
provide the transmission data F2X (SP1) (interframe 
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coding mode), which is the same as the processing 
mode for processing the I picture. In a second proc- 
essing mode, the difference (SP2) between the 
frame F2 and the succeeding frame F3 is calculated 
and the difference is coded for transmission (back- 
ward predictive coding mode). In a third processing 
mode, the difference (SP3) between the frame F2 
and the preceding frame F1 is coded for transmission 
(forward predictive coding mode). In a fourth proc- 
essing mode, the difference (SP4) between the 
frame F2 and the mean of the preceding frame F1 and 
the succeeding frame F3 is calculated and the differ- 
ence is coded to transmit transmission data F2X (bi- 
lateral predictive coding mode). 

One of the these processing modes, that will pro- 
vide the least amount of data is employed. 

A motion vector x1 representing the motion of the 
picture of the objective frame for the calculation of the 
difference (a motion vector between the frames F1 
and F2) (forward prediction) or a motion vector x2 (a 
motion vector between the frames F3 and F2 (back- 
ward prediction) or the motion vectors x1 and x2 are 
transmitted (bilateral prediction) as the difference 
data. 

Difference data (SP3) representing the differ- 
ence between the frame F3 of the P picture and the 
preceding frame F1 as a predicted picture, and a mo- 
tion vector x3 are calculated, and the difference data 
and the motion vector x3 are transmitted as transmis- 
sion data F3X (forward predictive coding mode) or the 
picture data (SP1) of the frame F3 is transmitted as 
the transmission data F3X (interframe coding mode). 
Either the forward predictive coding mode or the in- 
terframe coding mode that will more effective on re- 
ducing the amount of data is employed. 

As shown in Fig. 31, image data representing a 
picture of one frame consisting of V lines each of H 
dots per inch is sliced into N slices, i.e., a slice 1 to a 
slice N, each of, for example, sixteen lines, and each 
slice includes Ivt macroblocks. Each macroblock com- 
prises block data Yf1] to Y[4] including luminance data 
for 8*8 pixels, and block data Cb[5] to Cr{6] including 
color difference data corresponding to all the pixel 
data ( 1 6* 1 6 pixels data) of the block data Y[1 ] to Y[4]. 

Thus, the macroblock has the image data Y[1] to 
Y[4] of the 16*16 pixels successively arranged along 
the horizontal and vertical scanning directions as a 
unit for the luminance signal, and processes the two 
color difference signals for time-base multiplexing af- 
ter data compression and allocates the color differ- 
ence data for the 16*16 pixels to the blocks Cr[6] and 
Cb[4] each of 8*8 pixels to process one unit. The im- 
age data represented by the macroblocks are ar- 
ranged successively in the slice, and the image data 
represented by the blocks (8*8 dots) are arranged 
successively in a raster scanning sequence in the 
macroblock (16*16 dots). 

The image data Y[1] to Y[4] and the color differ- 
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ence data Cb[5] and Cr[5] are transmitted in that or- 
der. The numerals in the reference characters denot- 
ing the data indicate the data's turn for transmission. 
Low-resolution image data can be obtained by 
5 compressing (thinning out) high-resolution image 
data, such as high definition television data, by half 
with respect to both the vertical and horizontal direc- 
tions. The aspect ratio of the low-resolution image 
data can be changed from 16:9 to 4:3, and the low- 
10 resolution image data can be displayed on a display 
of the NTSC system. 

When displaying a high-resolution picture after 
compressing the same to 1/4 (1/2 * 1/2), the decoder 
9 shown in Fig. 27 is formed, for example, in a con- 
15 figuration shown in Fig. 32. In this case, the image 
data is compressed by the encoder 7 in a DCT mode 
(discrete cosine transformation mode). 

Image data (DCT coefficients) obtained by the 
DCT of the image data in units each of 8*8 pixels is 
20 given to the extraction circuit 21 of the decoder 9, and 
then the extraction circuit 21 extracts 8*8 data of 8*8 
pixels as shown in Fig. 33. The 8*8 data are DCT 
coefficients. In Fig. 33, a lower DCT coefficient cor- 
responds to a higher-frequency component of the pic- 
25 ture than an upper DCT coefficient with respect to the 
vertical direction, and a right-hand DCT coefficient 
corresponds to a higher-frequency component of the 
picture than a left-hand DCT coefficient with respect 
to the horizontal direction. 
30 An extracting circuit 22 disposed behind the ex- 

tracting circuit 21 extracts the 4*4 DCT coefficients 
shown in Fig. 34 corresponding to the lower-frequen- 
cy components among the 8*8 DCT coefficients 
shown in Fig. 33. Thus, the 8*8 pixels data is thinned 
35 out by half with respect to both the horizontal direc- 
tion and the vertical direction to produce 4*4 pixels 
data. The DCT coefficients shown in Fig. 34 are the 
4*4 DCT coefficients in the upper lefthand portion of 
Fig. 33. The 4*4 DCT coefficients extracted by the ex- 
40 tracting circuit 22 are given to an Inverse Discrete Co- 
sine Transformation circuit (IDCT circuit) 23 for in- 
verse discrete cosine transformation to obtain image 
data (4*4 pixels data) of a resolution of 1/2 with re- 
spect to both the horizontal direction and the vertical 
45 direction. 

Fig. 35 is a block diagram showing a circuit con- 
figuration of the encoder 7 by way of example. 

Macroblocks of image data to be coded, such as 
image data of high-resolution HDTV picture, are ap- 
50 plied to a motion vector detecting circuit 50. The mo- 
tion vector detecting circuit 50 processes the image 
data of each frame in an I picture, a P picture or a B 
picture according to a specified sequence. The mode 
of selection of an I picture. P picture or a 8 picture in 
55 processing the image data of the frames sequentially 
applied to the motion vector detecting circuit 50 is de- 
termined beforehand. For example, a group of pic- 
tures of the frames F1 to F17 are processed in I pic- 
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fores. P pictures and B pictures, respectively, as 
shown in Fig. 29. 

The image data of the frame to be processed in 
an I picture, for example, the frame F1. is transferred 
o and stored in the forward original image area of a 
frame memory 51. the image data of the frame to be 
processed in a B picture, for example, the frame F2 
;s transferred to and stored in the reference original 

3^ fJ'f frame mem ° r * and «Z im- 
age data of the frame to be processed in a P picture 

^hT P !!' frame F3, iS to and stored 

m the backward original image area 51c of the frame 
memory 51. 

a nir ? e " the im f 96 0f 3 frame to ^ processed in a 
B picture (frame F4) or P picture (frame F5) is given 
m the next cycle to the motion vector detecting circuit 

ttl f- TV* 13 ° f the 1 irst P P ict "re (frame F3) 
stored .n the backward original image area 51c is 
transferred* the forward original image area 51a, 
the .mage data of the next B picture (frame F4) is star- 
ed toverwntten) in the reference original image area 

i 1 1 r a9e data of the next p picture < frame w) 

( ° V * rwntten > in the backward original image 
area 51c. These operations are repeated sequential- 

The image data of the pictures stored in the frame 
memory 51 ,s read from the frame memory 51, and 
hen a pred.ction mode switching circuit 52 processes 
the image data in a frame prediction mode or a field 
Prediction mode. An arithmetic unit (prediction circuit) 
53 operates under control of a prediction mode select- 
ing circuit 54 for intraimage prediction, forward predic- 
t-on. backward prediction or bilateral prediction. The 
selection of one of these predictive coding modes is 
dependent on a prediction error signal representing 
the difference between the objective reference origi- 
nal image and the corresponding predicted image. 
Accordingly, the motion vector detecting circuit 50 
produces the sum of absolute values or the sum of 
squares of prediction error signals for use for the se- 
lection of the prediction mode. 

circu?s ? ° T^T ° f Pr8diCti0n mode switcnin 9 
circu,t 52 for selecting either the frame prediction 

mode or the field prediction mode will be described 
hereinafter. 

When the frame prediction mode is selected the 
prediction mode switching circuit 52 transfers the four 
hjmmanc. blocks YfU to Y[4] given thereto from the 
motion vector detecting circuit 50 as they are to the 
arithmetic unit 53. In this case, as shown in Fig. 36(A) 
each luminance block has, in combination, both the 
data representing the lines of odd fields and that rep- 
resenting the liens of even fields. In the frame predic- 
tion mode, the four luminance blocks (macroblocks) 
are processed in a unit for prediction, and a single mo- 
tion^vector is determined for the four luminance 

When the field prediction mode is selected, the 



prediction mode switching circuit 52 changes the lu- 

ZTL b T kS < Yf1] ^ a ™ n 9 fi- 
nance blocks of an arrangement shown in Fig. 36(A) 

received from the motion vector detecting circuit 50 

el**™ 9 ? int ° th0S8 ° f d0tS of lines ° f °dd fields' 
changes the other luminance blocks Y[3J and Yf41 
into hose of lines of even fields as shown in ™ 
36(B). anc I g.ves an output signal of an arrangement 
shown ,n F,g. 36(B) to the arithmetic unit 53. In this 
case, one motion vector (motion vector for the odd 
frelds corresponds to the two luminance blocks Y[1] 
TJl -m 8 ? ° thermotionvec tor(motionvectorforthe 

15 The motion vector detecting circuit 50 gives a sig- 

nal representing the sum of absolute values of predic- 
tion errors in the frame prediction mode, and a signal 
representing the sum of absolute values of prediction 
errors ,n the field prediction mode to the prediction 
20 mode switching circuit 52. The prediction mode Se- 
lecting circuit 52 compares the sums of absolute val- 

ann t Pr , ed i? i0n err ° re in tne frame P redi <*°n mode 
and the field prediction mode, carries out a process 

25 Z'lZ 7 t0 PrediCti0n mode smaller than 
25 the other ,n the sum of absolute values of prediction 
errors, and gives data obtained by the process to the 
anthmetic unit 53. 

Practically, such a process is carried out by the 

30 2!°? V6C,0r det6Cting CirCuit 50 - The motion vector 
30 detecting circuit 50 gives a signal of an arrangement 
corresponding to the selected mode to the prediction 
mode switching circuit 52. and then the prediction 

ZT^ IK" 9 C ' rCUit 52 9iV6S the in P ut si 9" al es it 
is to the arithmetic unit 53. 

35 In t he frame prediction mode, the color difference 

signal having, in combination, both the data repre- 
senting the lines of the odd fields and the data rep- 
resenting lines of the even fields as shown in Fig 
36(A) is g,ven to the arithmetic unit 53. In the field 
40 prediction mode, the respective upper halves (four 
lines) of the color difference blocks Cb[5] and Crf61 
f n ;^" 9 ; into a color Terence signal represent- 
Y»i t h COrrespondin 9 '0 the luminance blocks 
Y[1] and Y[2J, and the respective lower halves (four 
45 lines) of the color difference blocks Cb[5] and Crr 6 ] 
are changed into a color difference signal represent- 

2 rv?„ fie,dS corres P ondin 9 to the luminance 
blocks Y[3] and Y[4] as shown in Fig. 36(B) 

The motion vector detecting circuit 50 produces 
50 he sum of absolute values of prediction errors for use 
for determining a prediction mode for intraimage pre- 
d.ction. forward prediction, backward prediction or bi- 
lateral prediction by the prediction mode selecting cir- 
cuit 54. s 

55 The difference between the absolute value j I 

Ay I of the sum |Aij| of the signals Aij of the macro- 
blocks of a reference original image and the sum 
IZijl of the absolute values |Aij| of the signals Aij of 
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the macroblocks is calculated as the sum of absolute 
values of prediction errors for intraimage prediction. The 
sum S I Aij -Bij I of the absolute values I Aij-Bij I oftne 
differences (Aij - Bij) between the signals Aij of the mac- 
roblocks of the reference original image and the sig- 
nals Bij of the macroblocks of a predicted image is cal- 
culated as the sum of absolute values of prediction er- 
rors for forward prediction. The sums of absolute val- 
ues of prediction errors for backward prediction and 
bilateral prediction are calculated in manners similar 
to that of calculating the sum of absolute values of 
prediction errors for forward prediction, using predict- 
ed images different from that used for the calculation 
of the sum of absolute values of prediction errors for 
forward prediction. 

These sums of absolute values are given to the 
prediction mode selecting circuit 54. The prediction 
mode selecting circuit 54 selects the smallest sum of 
absolute values of prediction errors among those giv- 
en thereto as the sum of absolute value of prediction 
errors for inter- prediction, compares the smallest 
sum of absolute values of prediction errors and the 
sum of absolute values of prediction errors for intra- 
image prediction, selects the smaller sum of absolute 
values of prediction errors, and selects a prediction 
mode corresponding to the selected smaller sum of 
absolute values of prediction errors; that is, the intra- 
image prediction mode is selected if the sum of abso- 
lute values of prediction errors for intraimage predic- 
tion is smaller, the forward prediction mode, the back- 
ward prediction mode or the bilateral prediction mode 
corresponding to the smallest sum of absolute values 
, of prediction errors is selected if the sum of absolute 
values of prediction errors for the inter-predict.on is 

smaller. . _ . 

Thus, the motion vector detecting circuit 50 gives 
the signals representing the macroblocks of the ref- 
erence original image and having an arrangement 
corresponding to the prediction mode selected by the 
prediction mode switching circuit 52. i.e.. either the 
frame prediction mode or the field prediction mode, 
through the prediction mode switching circu.t 52 to 
the arithmetic circuit 53. detects a motion vector be- 
tween a predicted image corresponding to the predic- 
tion mode selected by the prediction mode selecting 
circuit 54 among those four prediction modes and the 
reference original image, and gives the detected mo- 
tion vector to a variable-length cording circu.t 58 and 
a motion compensating circuit 64. As mentioned 
above, a motion vector that makes the corresponding 
sum of absolute values of prediction errors smallest 
is selected. 

The prediction mode selecting circuit 54 sets an 
intraframe (image) prediction mode, in which motion 
compensation is not performed, as a prediction mode 
while the motion vector detecting circuit 50 is reading 
the image data of an I picture from the forward ong.nal 
image area 51a. and connects the movable contact 



53d of the switch of the arithmetic unit 53 to the fixed 
contact a of the same. Consequently, the image data 
of the I picture is applied to a DCT mode switching cir- 
cuit 55. 

5 The DCT mode switching circuit 55 gives data 

representing four luminance blocks having, in com- 
bination, lines of odd fields and those of even fields 
as shown in Fig. 37(A) (frame DCT mode) or data rep- 
resenting four luminance blocks individually having 
,o lines of odd fields and those of even f ields as shown 
in Fig. 37(B) (field DCT mode) to a DCT circuit 56. 

The DCT mode switching circuit 55 compares the 
coding efficiency of the frame DCT mode and that of 
the field DCT mode, and selects the DCT mode which 
,s is higher in coding efficiency than the other. 

For example, the DCT mode switching circuit 55 
forms the data representing blocks having, in combin- 
ation, lines of odd fields and those of even fields as 
shown in Fig. 37(A). calculates the differences be- 
2 o tween signals representing the vertically adjacent 
lines of odd fields and even fields, and calculates the 
sum of absolute values of the differences (or the sum 
of squares of the differences) or forms the data rep- 
resenting blocks of lines of odd fields and those of 
25 lines of even fields as shown in Fig. 37(B). calculates 
the differences between the vertically adjacent lines 
of odd fields and those between the vertically adja- 
cent lines of even fields, calculates the sum of abso- 
lute values (or the sum of squares) of the former dif- 
30 ferences and the sum of absolute values (or the sum 
of squares) of the latter differences, compares the 
former and latter sums of absolute values, and se- 
lects a DCT mode corresponding to the smaller sum 
of absolute values; that is. the frame DCT mode is se- 
35 lected when the former sum of absolute value is 
smaller or the field DCT mode is selected when the 
latter sum of absolute value is smaller. 

When the prediction mode switching circuit 52 se- 
lects the frame prediction mode (Fig. 36(A)) and the 
4 o DCT mode switching circuit 55 selects the frame DCT 
mode (Fig. 37(A)), and when the prediction mode 
switching circuit 52 selects the field prediction mode 
(Fiq 36(B)) and the DCT mode switching circuit 55 
selects the field DCT mode (Fig. 37(B). the DCT 
45 mode switching circuit 55 need not change the ar- 
rangement of the data. o 
When the prediction mode switching circuit 52 se- 
lects the field prediction mode (Fig. 36(B)) and the 
DCT mode switching circuit 55 selects the frame DCT 
so mode (Fig. 37(A)). and when the prediction mode 
switching circuit 52 selects the frame prediction mode 
(Fiq 36(A)) and the DCT mode switching circuit 55 
selects the field DCT mode (Fig. 37(B)). the OCT 
mode switching circuit 55 rearranges the data. The 
ss prediction switching circuit 52 gives a prediction flag 
indicating either the frame prediction mode or the 
field prediction mode to the DCT mode switching cir- 
cuit 55 to instruct the DCT mode switching circuit 55 
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for such a process. 

The OCT mode switching circuit 55 gives data of 
an arrangement corresponding to the selected OCT 
mode to the OCT circuit 56 and gives a DOT flag in- 

leno J 9 !J* SeleCt6d DCT m ° de 10 tne triable- 
length coding circuit 58 and a converting circuit 65 

*wJk Predicti0n mode ^ the prediction mode 
sw.tch.ng c ,cu,t 52 (Fig. 36) and the DCTmode in the 

* ? drCUit 55 (R ' 9 - 37 > are su bstan- 
-ally the same ,n the arrangement of the data of the 
luminance blocks. 

>^ en < PrediCtl '° n m ° de switcnin 9 circuit52 se- 

have Loth rH 8 , PrediCti r m0de • in Which the block s 
have both odd lines and even lines in combination, it 

55 w£ IT tha n he DCT ^"-i«ching circui 

have both 1 ?™ DCT m0de ' in Which the bl0 <** 
have both odd lines and even lines in combination. 

the frame prediction mode, in which the blocks have 
odd lines and even lines individually, it is highly prob- 

z e f e t :z\ DC i mo(Se switcwna **■ 55 

InH h ? ? m ° d8, Which the data of °dd fields 
and that of even fields are separated from each other. 

do~„Tr ° CT m0de switchin 9 «>cuit 55 
i£J m n?x yS Se,6Ct 6ither the frame DCT mode or 
the field DCTmode in such a manner; the prediction 
mode switching circuit 52 determines a mode so that 
H JT, T°J UtB Va ' UeS ° f prediction «™ is the 

teTmine ' T ^ ° CT ^ SWitchi " 9 circui < 55 de- 
termines the mode so that coding can be achieved at 
a high coding efficiency. 

The DCT mode switching circuit 55 gives image 
data representing an I picture to the DCT circuit 56 
and the ,mage data is transformed into DCT coeffi- 
cients by DCT (discrete cosine transformation). The 
DCT coefficients are quantized at a quantizing step 
corresponding to the amount of data stored stored in 

curt 57 S ?„ S H S, °H n bUffer mem ° ry 59 by a auantizi "9 * 
^ ht ' he , quantlzed DCT coefficients are given 
to the variable-length coding circuit 58 

th*,-!! 16 V * riable "' en9th COdin9 circuit 58 inverts 
he .mage data (,n this case, the data of the 1 picture) 

£2 I"" the qU3ntiZina circuit 57 '"to variable- 
ength codes, such as Huffman codes, according to 
he quantizing step (scale) used for quantization by 
he quantizing circuit 57; and gives the variable- 
length codes to the transmission buffer memory 59 
The quantized DCT coefficients for a low-fre- 
quency range (DCT coefficients having large power) 
are in the upper left-hand corner (the DCT coeffi- 
cients ,n the upper left-hand corner of the table of 8.8 
DCT coefficients shown in Fig. 33) owing to the char- 
acteristics of DCT. Generally, the coefficient is coded 
n a combination of a run length of successive zeros 
zero-run length) and a coefficient (level, by variable- 
eng h coding. A coding method using zero-run 

112 h T l6Ve,S 10 combinatio " « called a run 
length coding method. When coefficients are coded 



former. T C ° din9 meth ° d ' lon 9 2er °-runs can be 
formed by transmitting the coefficients in zigzag 
scanning sequence as shown in Fig. 38, in which nu 

5 tTatth in H dl 'f e C ° effiCientS ' tUrns c'transmrssion so 
5 that the data can be compressed 

The variable-length coding circuit 58 codes bv 
variable-length coding the quantizing step (scale) 

io wi?51 tyP6) (intraima9e predic «on mode, or- 
S1 P !° n m0de ' b3Ckward P redic «on mode or 
bilateral pred.ction mode) selected by the prediction 
mode selecting circuit 54, the motion Vector de er- 
mined by the motion vector detecting circu t 50 h e 
prediction flag (frame prediction mode flag or fieW 
« prediction mode flag) set by the prediction mode 
switching circuit 52, and the DCT f.ag (frame DCT 
mode flag or f.eld DCT mode flag) set by the DCT 
mode itchj circujt 55 « w . th V the DCT 

scanned quantized data. 
20 t h.r™ ter St ° ring thS transmisa ion data temporarily 

daL7na^T nbUffer59SendSOUt ^ 
data n a bit stream at specified time and controls the 

Sinn! 9 SC3,e ty S6ndin9 a ^antization control 
is datal ; re H P ° nding t0 thS am0unt of «» ™sidua. 
S Z maCr0b,ock to tb e quantizing circuit 57. 

2 *Z 7? T bUffer mem ° ry 59 thus plates 

aooZ", d3ta SSnt ° Ut in 3 bit stream 10 "old an 
appropriate amount of data (amount of data that will 
not cause overflow or underflow) therein 

the ^.rT? e ' UP ° nthedecreaseofthea ^ntof 
£LTt£ 13 he ' d thS Emission buffer 
memory 59 to an upper limit, the transmission buffer 

£cZ« J Pr0Vid8S 3 quanti2a «C" control signal to 
35 h f : ?, Uami2in9 SCale to be used °V the quan- 

the am0Unt ° f P-ntized data 

cZ 2 m, V qUantizin9 circuit 57 ««' ^ de- 
creased. Upon the decrease of the amount of the re- 
sidual data held in the transmission buffer memory 59 
40 Uh ^ fransrniss icn buffer memory 59 
40 provides a quantization control signal to decrease the 

SSSf.?' t0 be used by the quantizin9 

57 so that the amount of quantized data quantized by 
the quantizing circuit 57 will be increased 

45 m «J he ° C o PUt bit Stream 0f the ^nsmission buffer 
45 memory 59 ,s combined with a coded audio signal 
synchronizing signals and the like to produce a muN 
*plex s.gnal. an error correction code is added to the 
multiplex signal, the multiplex signal is subjected to 
so m i? modulation, and then the modulated 

so mt.rt.plex signal is recorded in pits on a master disk 

I^hIT, 301 COntr0 " ed acCOrdina to the modu- 
ated multiplex signal. A stamping disk for duplicating 
the master disk is formed by using the master disk to 

55 S s ^ reCOrdi " 9 media *' SUCh 33 ° p,iCal 
Tn edataof the ,pi Ctureprovjded 
-ng circuit 57 is inversely quantized by an inverse 
quantizing circuit 60 at a step provided by the quan- 
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tizing circuit 57. The output of the inverse quant.z.ng 
circuit 60 is subjected to IDCT (inverse OCT) in an 
IDCT circuit 61 , and the output of the .OCT circu, 61 
is given to the converting circuit 65. The converting 
circuit 65 converts the input data from the IDCT " crcurt 
61 according to a OCT flag provided by the OCT mode 
switching circuit 55 and a prediction flag provided by 
the prediction mode switching circu.t 52 .n to data of 
frame prediction mode (Fig. 36(A)) or data of f -eld pre- 
diction mode (Fig. 36(B)) so that the converted data 
matches the predicted image data prov.ded by the 
motion compensating circuit 64. and then converted 
data is given to an arithmetic unit 62. Data prov.ded 
bv the arithmetic unit 62 is converted into data of 
frame prediction mode (Fig. 36(A)) according to the 
prediction flag by a conversion circuit 66 and then 
the converted data is stored in Uie forward pred.cted 
image area 63a of a frame memory 63. 

The frame memory 63 may be substituted by a 
field memory. When a field memory is used instead 
of the frame memory 63. the output data of the arith- 
metic unit 62 is converted into data of field prediction 
mode (Fig. 36(B)) by the converting circuit 66. be- 
cause data of f ields are stored individually. 

When processing sequential input image data ot 
frames as. for example. I. B. P. B. P. B ... pictures the 
motion vector detecting circuit 50 processes the im- 
age data of the first input frame as an I picture, and 
then processes the image data of the third input 
frame as a P picture before processing the image data 
of the second input frame as a B picture, because the 
B picture requires backward prediction and the B pic- 
ture cannot be decoded without using the P picture, 
i e a backward predicted image. 
' " After processing the I picture, the motion vector 
detecting circuit 50 starts processing the .mage data 
of the P picture stored in the backward original image 
area 51c and, as mentioned above, the motion vector 
detecting circuit 50 gives the sum of absolute values 
of the interframe differences (prediction errors) m 
each macroblock to the prediction mode switching cir- 
cuit 52 and the prediction mode selecting circuit 54. 
The prediction mode switching circuit 52 and the pre- 
diction mode selecting circuit 54 set a frame/field pre- 
diction mode or a prediction mode (block type) for in- 
traima ge prediction, forward prediction backward 
prediction or bilateral prediction according to the sum 
of absolute values of prediction errors in the macro- 
. block of the P picture. 

When the interframe prediction mode is set, tne 
movable contact 53d of the arithmetic unit 53 is con- 
nected to the fixed contact a. Consequently, the data 
. similarly to the data of the . picture is provided 
through the OCT mode switching circuit 55, the DC i 
circuit 56. the quantizing circuit 57. the vanabe- 
length coding circuit 58 and the transmitting buffer 
memory 59 on a transmission line. The data is also 
sent through the inverse quantizing circuit 60. the 



IDCT circuit 61, the converting circuit 65, the antie- 
metic unit 62 and the converting circuit 66 to the back- 
ward predicted image area 63b of the frame memory 
63 for storage. 

s When the forward prediction mode is set, the 

" movable contact 53d of the arithmetic unit 53 .s con- 
nected to the fixed contact b. and the motion compen- 
sating circuit 64 reads the data of the I picture , from 
the forward predicted image area 63a of the frame 
,o memory 63 and execute motion compensation ac- 
cording to a motion vector provided by the motion vec- 
tor detecting circuit 50. 

When the prediction mode selecting circuit 54 se- 
lects the forward prediction mode, the motion com- 
)S pensating circuit 64 shifts the read address at a pos- 
ition corresponding to the macroblock being provided 
by the motion vector detecting circuit 50 in the for- 
ward predicted image area 63a according to the mo- 
tion vector, reads the data from the forward pred.cted 
2 o image area 63a and produces a predicted image data. 
The motion compensating circuit 64 arranges the pre- 
dicted image data in the arrangement shown ,n Fig. 
36 according to a frame/field prediction flag provided 
bv the prediction mode switching circuit52. 
25 The predicted image data provided by the motion 

compensating circuit 64 is given to an arithmetic unit 
53a The arithmetic unit 53a subtracts the predicted 
image data of a macroblock given thereto by the mo- 
tion compensating circuit 64 from the data of the cor- 
30 responding macroblock of a reference original image 
provided by the prediction mode switching circuit 52 
and provides difference data representing the differ- 
ence between those image data (prediction . error) 
through the OCT mode switching crcu.t 55, the DCT 
35 circuik the quantizing circuit 57, the , variable- 
length coding circuit 58 and the transm.tt.ng buffer 
memory 59 on the transmission line. The difference 
data is locally decoded by the inverse quant.z.ng c.r- 
cuit 60 the IDCT circuit 61 and the converting crcu.t 
40 65, and the locally decoded difference data is given 
to the arithmetic unit 62. 

The predicted image data given to the anthmehc 
unit 53a is given also to the arithmetic unit 62. The ar- 
ithmetic unit 62 adds the predicted image .data provid- 
45 ed by the motion compensating crcu.t 64 to the d f 
ference data provided by the converting circu. 65 to 
obtain the image data of the °"9' na, < de ^>^ s 
ture. Since the image data of the ong.nal P picfcre « 
arranged in the arrangement shown in Fig. 36 by the 
50 prediction mode switching circuit 52, a converter- 

for frame prediction as shown in Fig. 36(A) (or in the 
arrangement for field prediction mode shown in Fig. 
36?B) when the frame memory 63 is a field memory 
S5 acco ding to the prediction flag. The .mage data of 
the P picture is stored in the backward predicted im- 
age area 63b of the frame memory 63. 

After the image data of the I picture and that of 
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he P p.cture have been thus stored respectively in 

warf D r r?r Cted ima9e 3rea 633 and "» Re - 
ward predated ,mage area 63b, the motion vector de- 

the Bnir| rCU Th 6X600168 '*» for 
and Z h- I PrediCti0n m ° de SWitchin 9 Ocuit 52 
and the pred.ct.on mode selecting circuit 54 sets eith- 

modo a ! PrediCti0n m ° de or the field Prediction 
mode according to the sum of absolute values of the 
mterfra d , ferences fQf ^ ^ ^ of the 

ttVZ TTr**™ m0de ' the forw erd predic- 
tion mode the backward prediction mode or the Mat- 
eral prediction mode. 

As mentioned above, when the intraframe predic- 
tion mode or the forward prediction mode is set. the 

r^d Ct53diSCOnn6Ctedt0thefiXed COntact 

b. and then the same process as that for the P picture 

is earned out and data is transmitted 

era. ZlTf* Pr8diction mode or tne bilat- 

eral pred.ct.on mode is set, the movable contact 53d 
connected to the fixed contact c or d 
When the movable contact 53d is connected to 
he f ,xed contact c for the backward prediction mode 

tth I h f baCkW3rd Predicted ima 9* area 

pensabon h 8 T*" ' S Pr ° C6SSed f ° rmo,ion c °- 
pensabon by the motion compensating circuit 64 ac- 
cording to a motion vector provided by the motion 
hector detecting circuit 50. When the backward 

SSSUL", Ti by the prediction mode se,ec ' n 9 

'he Id t,0 ° COm P ensat, 'ng Circuit 64 shifts 

la 63o fr„l reSS ' n the baCkWart Predicted ima 9« 
area 63b from a position corresponding to the posi- 

vector detecting c.rcuit 50 according to the motion 

ZTtT* d3ta ' Pr ° dUCeS P^tedTmage 
Shi!: i rea : ran 9 es the da ta in an arrangement 
shown in F,g. 36 according to a prediction flag provid- 
ed by the prediction mode switching circuit 52 

orPdUL™* 0 ", 00 ^ 6 " 83 "" 9 circuit 64 9'Ves the 
predicted .mage data to an arithmetic unit 53b The ar- 
.thmebc : unit 53b subtracts the predicted image data 

the dl oTth m ° ti0n COmpensa «"9 circuit 64 from 
the data of the macroblock of the reference original 
.mage p^ed by the prediction mode switching cir- 
cuit 52 to obtain difference data representing the dif- 
ferences between the image data. The difference 

cu?55 T d n e r d T hr ° U9h DCTm ° de Switenin 9 cir- 
Z J? m ? CT C ' rCUit 56 ' the duantizi "9 circuit 57. 
he vanable-length coding circuit 58 and the transmit 
t-ng buffer memory 59 on the transmission line. 
When the movable contact 53d is connected to 

Idl'Th C ° ntaCt d t0 S6t the bi,ateral Miction 
mode, the image data (image data of the I picture in 

a lT } ''dr 1 fr ° m the f ° rWard predicted -age 
area 63a and the image data (image data of the P pic- 
tore in lhls t , js ^ ^ ^ ^ 

-mage area 63b, and then both the image data are 
processed for motion compensation by the motion 



compensating circuit 64 according to the motion vec- 
tor provided by the motion vector detecting circuit s". 

ZZl f ' Ct,0n m ° de Selectin 9 ci ^it 54 sets 
the bilateral prediction mode, the motion compensat- 

red'S *** th6 re3d addrSSSes in ,ne '"ward 
predicted .rnage area 63a and the backward predict- 

the ^'f ? 6 fr0m POSitions corresponding to 
the pos,t.on of the macroblock being provided J he 
motion vector detecting circuit 50 according to two 
TT TV f ° r the f ° rWard predictad -age nd 
a^ imThe f Predi H ed image ' res P«c«ve.y, 9 rea s 
Z\TZ ! T 6 PrediC,ed ima 9 e area 63a and 
the backward predicted image area 63b, and produc- 
es predated image data. The predicted image data is 

the prediction mode switching circuit 52 

The motion compensating circuit 64 gives the 
predicted image data to an arithmetic unit 53c The a ' 
thmetic unit 53c subtracts the mean of the predicted 
' ma 9 a f a Prided by the motion compensating c r 
cu.t 64 from the data of the macroblock of the refer- 
ence original image provided by the motion vector de- 
he DC??d 50 t0 Pr ° Vide diff6renCe data ««C 
25 SB h-I * SW ' tChin9 C,rCUit 55 ' the DCT circuit 
25 56, the quantizing circuit 57, the variable-length cod- 
ing circuit 58 and the transmitting buffer memory 59 
on the transmission line. 

frJal ima9e c°, f the 8 Picture is not st ° red i" the 
frame memory 63 because the same is not used as 
30 a predicted image for other images 

diJ!! h6 " neCessarv ' tne ^nk S of the forward pre- 
2 ' ma9e araa 63a and tne backward predicted 
image area 63b of the frame memory 63 can be 

35 ttTA 10 r Vlde thS f ° rWard predic " ed - a 9e or 
35 the backward predicted image stored in either the for- 

dic ^ t6d ima96 afea 633 ° r the back " a ' d Pre- 
o ?h a in I 9e , area 636 33 3 f0fWard predic ted image 
or a backward predicted image for a specified refer- 
ence original image. 

40 a DOl fJd h0U9h | enCOd6r 7 h3S ° een eX P ,a '" ad « 
the l a k.' V° processin 9 ^ 'finance blocks, 
the macroblocks of the color difference blocks shovvn 

ran^mittfd a !■ " e Sl ' mi,arly processed a " d 
45 m ° n V6Ct0r for P r °cessing the color 

43 drfference block is half the motion vector of the cor- 
respondrng luminance block with respect to the vert- 
ical direction and the horizontal direction 

The decoder 9 will be described hereinafter with 

50 Tat*?! 0 F ! 9 - 39> A ° iRPUt bit Stream representing 
50 .mage data stored in the recording medium 8 (Fig 
27). such as an optical disk, is given to the decoder 
9. The input bit stream is transmitted through a receiv- 

2uMVLC^ y l° t0 3 Variable - Ie "9th decoding 
circuit (IVLC) 71 fordecodingtoobtain quantized data 

i nrr « C,entS) ' m0t, '° n V6Ct0rs - 3 Prediction flag, 
a DCT flag and a quantization scale. The data (DCT 
coefficients) provided by the variable-length decod- 
ing circuit 71 is ,-nverse.y quantized by an inverse 
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quantizing circuit 72 to provide representatives. The 
step of inverse quantization is regulated according to 
the quantization scale provided by the variable- 
length decoding circuit 71. 

For each block, 8*8 quantized reproduced values s 
(OCT coefficients) are provided by the inverse quan- 
tizing circuit 72. An IDCT circuit 73 processes the 8*8 
coefficients for IDCT to obtain a block having 8*8 pix- 
els data. The output of the IDCT circuit 73 is rear- 
ranged according to a DCT flag and a prediction flag w 
provided by the variable-length decoding circuit 71 by 
a converting circuit 77 in an arrangement coinciding 
with the arrangement of data provided by a motion 
compensating circuit 76. The output of the converting 
circuit 77 is given to an arithmetic unit 74. 15 

When image data representing an I picture is giv- 
en to an arithmetic unit 74, the arithmetic unit 74 gives 
the image data to a converting circuit 78, which in turn 
rearranges the image data according to a prediction 
flag provided by the variable-length decoding circuit 20 
71 in an arrangement for frame prediction mode 
shown in Fig. 36(A) (for field prediction mode shown 
in Fig. 36(B) when a field memory is used instead of 
a frame memory 75) and stores the image data in the 
forward predicted image area 75a of the frame mem- . 25 
ory 75 to use the same for producing a predicted im- 
age data of the next image data given to the arithmet- 
ic unit 74. The image data is given also to a format 
conversion circuit 10 (Fig. 27). 

When image data for forward prediction repre- 30 
senting a P picture using the image data of the pre- 
ceding frame as predicted image data is given to the 
arithmetic unit 74, the image data representing the 
preceding frame (image data of an I picture) is read 
from the forward predicted image area 75a of the 35 
frame memory 75, the image data is subjected to mo- 
tion compensation in a motion compensating circuit 
76 according to a motion vector provided by the vari- 
able-length decoding circuit 71, processed according 
to the prediction mode (block type) and the image 40 
data is rearranged as shown in Fig. 36 according to 
the prediction flag. The arithmetic unit 74 adds the re- 
arranged data and image data (difference data) pro- 
vided by the converting circuit 77. The added data, 
i.e., the decoded image data of the P picture, is stored 45 
in the backward predicted image area 75b of the 
frame memory 75 for producing predicted image data 
of the next image data given to the arithmetic unit 74 
(image data of a B or P picture). 

When the image data representing a P picture is so 
the data for the intraimage prediction mode, the im- 
age data, similarly to that of the I picture, is not proc- 
essed by the arithmetic unit 74 and is stored in the 
backward predicted image area 75b as it is. 

Since the P picture is to be displayed next to the 55 
next B picture, the image data representing the P pic- 
ture is not given to the format converting circuit 10 at 
this time, because, as mentioned above, the P picture 

9 



entered after the B picture is processed and transmit- 
ted before the B picture. 

When the image data representing the B picture 
is provided by the converting circuit 77, either the im- 
age data of the 1 picture stored in the forward predict- 
ed image area 75a of the frame memory 75 (in the for- 
ward prediction mode) or the image data of the P pic- 
ture stored in the backward predicted image area 75b 
(in the backward prediction mode) is read or both the 
image data (in the bilateral prediction mode) are read 
according to a signal representing the prediction 
mode provided by the variable-length decoding cir- 
cuit 71, the read image data is processed for motion 
compensation by the motion compensating circuit 76 
according to a motion vector provided by the variable- 
length decoding circuit 71, the motion-compensated 
image data is rearranged according to the prediction 
flag to produce a predicted image. When motion com- 
pensation is unnecessary (intraimage prediction 
mode), any predicted image is not produced. 

The arithmetic unit 74 adds the output of the con- 
verting circuit 77 and the image data motion-compen- 
sated by the motion compensating circuit 76, and the 
sum of addition is given to the format converting cir- 
cuit 10 after being restored to a state for the frame 
prediction mode according to the prediction flag by 
the converting circuit 78. 

Since the sum of addition is the image data of the 
B picture and is not used for producing the predicted 
image of other images, the sum of addition is not stor- 
ed in the frame memory 75. 

After the image of the B picture has been provid- 
ed, the image data of the P picture is read from the 
backward predicted image area 75b and provided 
through the motion compensating circuit 76, the ar- 
ithmetic unit 74 and the converting circuit 78. This im- 
age data is not processed for motion compensation 
and rearrangement. 

The color difference signals can be processed 
similarly to the luminance signal, then processing the 
color difference signals, a motion vector half the mo- 
tion vector used for processing the luminance signal 
with respect to the vertical direction and the horizon- 
tal direction is used. 

The image thus reproduced is subjected to D/A 
conversion to obtain a decoded image for high- 
resolution HDTV. 

The decoder 9 shown in Fig. 39 is provided with 
a configuration comprising an inverse quantizing cir- 
cuit 81 , a converting circuit 89 and the associated cir- 
cuits for obtaining a decoded image of a quarter-re- 
solution image (image for standard TV) in addition to 
the configuration for obtaining the decoded image for 
HDTV. The inverse quantizing circuit 81 obtains rep- 
resentatives by the inverse quantization of the data 
provided by the variable-length decoding circuit 71 
according to a quantizing scale provided by the vari- 
able-length decoding circuit 71 and gives the repre- 
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sentatives to a selecting circuit 82. The decoder 9 is 
provided with the inverse quantizing circuit 81 to pro- 
vide both a StanDard TV image (SDTV image) and a 
HDTV image. The inverse quantizing circuit 81 may 
be omitted when only one of the SDTV image or the 
HDTV .mage is necessary. When the inverse quan- 
tizing circuit 81 is omitted, the output of the inverse 
quantizing circuit 72 is given to the selecting circuit 
82, 

The selecting circuit 82 selects the 4*4 DCT coef- 
ficients shown in Fig. 34 among the 8*8 DCT coeffi- 
cients shown in Fig. 33 to obtain the DCT coefficients 
of 4.4 pixels data of quarter-resolution by half thin- 
ning out the 8.8 pixels data with respect to the vert- 
ical direction and the horizontal direction. 

An IDCT circuit 83 processes the input 4.4 DCT 
coefficients for IDCT and gives data to the converting 
circuit 88. The converting circuit 88 rearranges the 
data according to a DCT flag and a prediction flag pro- 
vided by a motion compensating circuit 86 so that the 
arrangement of the data coincide with the arrange- 
ment of the predicted image provided by a motion 
compensating circuit 86. 

The data rearranged by the converting circuit 88 
is given to a arithmetic unit 84. The motion compen- 
sating circuit 86 changes the banks of a frame mem- 
ory 85 and motion-compensate the data stored in the 
frame memory 85 according to a prediction mode and 
a motion vector provided by the variable-length de- 
coding circuit 71, and rearranges the image data ac- 
cording to the prediction flag as shown in Fig. 36 to 
produce a predicted image data. 

The data provided by the motion compensating 
circuit 86 is added to the output of the converting cir- 
cuit 88. The data is rearranged in an arrangement for 
frame prediction mode (field prediction mode when a 
f ib d memory is used instead of the frame memory 
85) according to the prediction flag by the converting 
circuit 89 to provide a standard TV image data. Since 
the motion in the motion compensating circuit 86 is 
about half the motion in the motion compensating cir- 
cuit 76, the motion vector provided by the variable- 
length decoding circuit 71 is reduced by half by a scal- 
ing circuit 87 and the reduced motion vector is given 
to the motion compensating circuit 86. 

When the prediction mode selecting circuit 54 of 
the encoder 7 (Fig. 35) selects the frame prediction 
mode for the encoder 7. the decoder 9 is set also for 
the frame prediction mode. When the field prediction 
mode is selected for the encoder 7. the decoder 9 is 
set for the field prediction mode. Thus, when the mo- 
tion compensating circuit 64 of the encoder 7 (the mo- 
tion compensating circuit 76 of the decoder 9) produc- 
es a predicted image in the frame prediction mode 
the motion compensating circuit 86 of the decoder 9 
produces a predicted image in the frame prediction 
mode in cooperation with the scaling circuit 87 and 
when the motion compensating circuit 64 (the motion 



compensating circuit 76) produces a predicted image 
m the field prediction mode, the motion compensating 
circuit 86 produces a predicted image in the field pre- 
diction mode in cooperation with the scaling circuit 

5 of. 

The foregoing conventional image signal decoder 
uses the motion vector obtained simply by reducing 
the motion vector for decoding high-resolution image 
data by the scaling circuit 87 for motion compensation 
io when producing a low-resolution image. Accordingly 
the data of the block as the predicted image produced 
by the motion compensating circuit 86 does not coin- 
cide exactly with the data of the block obtained by the 
DCT of the data motion-compensated by the motion 
'5 compensating circuit 64 of the encoder 7 (the motion 
compensating circuit 76 of the decoder 9), extracting 
the low-frequency components of the output of the 
motion compensating circuit 64 and subjecting the 
ow-frequency components to IDCT. Therefore, a drift 
20 (a mismatching error) is produced between the data 
produced by the motion compensating circuit 86 and 
he data obtained by the encoder 7 and, consequent- 
ly, the data obtained by processing the data provided 
by the motion compensating circuit 86 by the arith- 
25 metic unit 84. i.e., the quarter-resolution SDTV image 
dat^ does not coincide exactly with the original 
HDTV image data. 

The quarter-resolution SDTV image data can be 
obtained by adding the 4*4 data produced by extract- 
30 ing the low-frequency components of the output of 
the quantizing circuit 57 of the encoder 7, i e the 4.4 
pixels data in the upper left-hand corner among the 
8«8 pixels data.subjecting the extracted 4.4 data to 
inverse quantization and subjecting the inversely 
35 quantized 4.4 data to IDCT and the 4*4 data pro- 
duced by subjecting the 8.8 pixels data provided by 
the motion compensating circuit 64 to DCT, extracting 
the low-frequency components, i.e., the 4.4 data 
from the 8.8 pixels data processed for DCT and sub- 
*o jecting the low-frequency components to IDCT How- 
ever, the quarter-resolution SDTV image data ob- 
tained by the decoder shown in Fig. 39 does not cor- 
respond exactly to the SDTV image data obtained by 
the encoder 7 by decoding. Therefore, if the period of 
45 arnval of intrapictures is extended, the interval be- 
tween the successive mismatching error resetting 
operations is increased, the mismatching errors are 
accumulated in the frame memory 85. and the drift 
appears on the screen as noise to spoil the quality of 
50 the picture. 

The present invention has been made in view of 
the foregoing problems and is intended to reduce mis- 
matching errors. 

Various aspects of the invention are set out in the 
55 appended claims. 

An image signal coding method in accordance an 
example of with the present invention that subjects a 
difference image signal representing the difference of 
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input image data from predicted image data to trans- 
formation or blocking to produce predetermined coef- 
ficient data, and codes the predetermined coefficient 
data comprises steps of producing first data by the in- 
verse transformation or reconstruction of the coeffi- 
cient data, extracting a predetermined portion of the 
coefficient data, producing second data by the in- 
verse transformation or reconstruction of the coeffi- 
cient data included in the predetermined portion, pro- 
ducing third data by extracting data corresponding to 
the predetermined portion from the first data and 
subjecting the extracted data to inverse transforma- 
tion or reconstruction, and calculating the difference 
between the second data and the third data, and cod- 
ing the difference. 

This method codes the difference data repre- 
senting the difference between the second and third 
data and transmits the coded difference data. Mis- 
matching errors can be corrected on the basis of the 
difference data. 

Exemplary embodiments of the invention will be 
described hereinafter, by way of example only, with 
reference to the accompanying drawings, in which: 

Fig. 1 is a block diagram showing the fundamen- 
tal configuration of an image signal encoder in accor- 
dance with the present invention. 

Fig. 2 is a block diagram showing the fundamen- 
tal configuration of an image signal decoder in accor- 
dance with the present invention. 

Fig. 3 is a block diagram of an image signal en- 
coder in a first embodiment according to the present 
invention. 

Fig. 4 is a block diagram of an image signal de- 
coder in a first embodiment according to the present 
invention. 

Fig. 5 is a block diagram of an image signal en- 
coder in a second embodiment according to the pres- 
ent invention. 

Fig. 6 is a block diagram of an image signal de- 
coder in a second embodiment according to the pres- 
ent invention. 

Fig. 7 is a block diagram of an image signal en- 
coder in a third embodiment according to the present 
invention. 

Fig. 8 is a block diagram of an image signal de- 
coder in a third embodiment according to the present 
invention. 

Fig. 9 is a block diagram of an image signal en- 
coder in a fourth embodiment according to the pres- 
ent invention. 

Fig. 10 is a block diagram of an image signal de- 
coder in a fourth embodiment according to the pres- 
ent invention. 

Fig. 11 is a block diagram of an image signal en- 
coder in a fifth embodiment according to the present 
invention. 

Fig. 12 is a diagram of assistance in explaining a 
motion compensating operation; 



Fig. 13 is a diagram of assistance in explaining a 
motion compensating operation to be carried out by 
motion compensating circuits 76 and 86 included in 
the image signal encoder of Fig. 11 in a frame predic- 
5 tion mode. 

Fig. 14 is a diagram of assistance in explaining 
another motion compensating operation to be carried 
out by the motion compensating circuit 76 and 86 in- 
cluded in the image signal encoder of Fig. 11 in the 
10 frame prediction mode. 

Fig. 15 is a diagram of assistance in explaining a r 
further motion compensating operation to be carried 
out by the motion compensating circuits 76 and 86 in- 
cluded in the image signal encoder of Fig. 11 in the 
is frame prediction mode. 

Fig. 16 is a diagram of assistance in explaining a 
motion compensating operation to be carried out by 
the motion compensating circuits 76 and 86 included 
in the image signal encoder of Fig. 11 in a field pre- 
20 diction mode. 

Fig. 17 is a block diagram of an image signal en- 
coder in a sixth embodiment according to the present 
invention. 

Fig. 1 8 is a d iagrammatic view of assistance in ex- 
25 plaining the operation of a selecting circuit 82 includ- 
ed in the image signal encoder of Fig. 17. 

Fig. 1 9 is a block diagram of an image signal en- 
coder in a seventh embodiment according to the pres- 
ent invention. 

30 Fig. 20 is block diagram of an image signal decod- 

er in a seventh embodiment according to the present 
invention. 

Fig. 21 is a block diagram of an image signal en- 
coder in an eighth embodiment according to the pres- 
35 ent invention. 

Fig. 22 is a block diagram of an image signal de- 
coder in an eighth embodiment according to the pres- 
ent invention. 

Fig. 23 is a block diagram of an image signal en- 
40 coder in a ninth embodiment according to the present 
invention. 

Fig. 24 is a block diagram of an image signal de- 
coder in a ninth embodiment according to the present 
invention. 

45 Fig. 25 is a block diagram of a method of fabricat- 

ing an image signal recording medium embodying the 
present invention. 

Fig. 26 is a block diagram of a method of produc- 
ing software in accordance with the present inven- 

50 tion. 

Fig. 27 is a block diagram of a conventional image 
signal encoder and a conventional image signal de- 
coder. 

Fig. 28 is a pictorial view of assistance in explain- 
55 ing a principle of data compression. 

Fig. 29 is a pictorial view of assistance in explain- 
ing types of pictures to be used for image data com- 
pression. 
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Fig. 30 is a diagram of assistance in explainina a 
principle of moving picture signal encoding 9 

n, a !„ • 31 13 3 dia 9 ramma «c view of assistance in ex- 
Plaming an ,mage data transmitting format 

er q fn 9 ,' !f '! * ^ ° f 3 P 0rtion Of a decod- 5 

er 9 included ,n the image signal decoder of Fig 27 

Fig. 33 ,s a table of data to be extracted by an ex- 
tracting circu.t 21 included in the decoder 9 of Fig 32 

F,g. 34 ,s a table of data to be extracted by an ex- 
tracting circuit 22 included in the decoder 9 of pfg 32 „ 

ed i L I* 3 ° k dia9ram ° f an encoder 7 W«* 
ed in the .mage signal encoder of Fig. 27 

Fig. 36 is a diagrammatic view of assistance in ex- 
plaining the operation of a prediction mode sw'ch.na 
arcuit 52 induded in the encoder of Fig. 35 SW ' ,Ch,n9 

Fig. 37 is a diagrammatic view of assistance in ex- 
P aining the operation of a DCTmode switching St 
55 included in the encoder of Fig 35 

g Fi 9-39isablockdiagramofthedecoder9ofFig. 

rnrfci" 'Tl 6 Si9nal enC ° der and an ima 9e signal de- 
coder embodying the present invention will be desert 
bed hereinafter Basically, the image signa. encoder 25 
and the image signal decoder embodying the presen 

entS Same ' n confi 9-aJon 9 a S th'e con 

ventional image signal encoder and the conventional 

ztjt d r der shown in Fig - 2? - 

coder embody.ng the present invention are provided 
respec hvely with an encoder 7 and a decoder 9 which 
are different from those of the conventional image 
s.gnal encoder and the conventional image signal 

oToved T din9 ' y ' enC ° der and tne da -'e - 35 
Ployed m the present invention will be described here- 
. ,n wh.ch parts like or corresponding to those of the 

ven ZTt Sh ° Wn " Fi9 ' 35 and the 
vent,ona,decodershowninFig.39aredenotedbythe 
same reference characters and the description there! 40 
of will be omitted at discretion. 

^/j St '! h >t fu i ndamental configurations of the en- 
coder an d the d eC0 der employed in the present in- 
vent,on will be described with reference to Figs. 1 and 
2. Referring to Fig. 1, the encoder 7 comprises a fu I 4S 
^0^^ encoding unit 101 and a quarter-resolution 
.mage forming unit 103. Basically, the full-resolution 
encoding unit 101 is the same in configuration as the 
encoder 7 shown in Fig. 35, except that the full- 
resolution encoding unit 101 is not provided with the 50 
predion mode switching circuit 52 and the OCT 
mode switching circuit 55. Therefore, the full- 

with hi enC ° din9 Unit 101 need not be Prided 
with the converting circuits 65 and 66 (Fig 35) 

hi„h w h f " 3 high - resoluti °n HDTV signal, typically, a 55 

v c^°dlf 6 : iSi0n S, ' 9nal ' iS aPP "' ed to a 
vector (MV) detecting circuit 50. a variable-length 

coding circuit (VLC) 58 provides a HD bit stream 06- 
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tamed by coding the high-resolution HDTV signal. A 

ccZ r h V t° Si9nal 34 produced * 'ocally de- 
tail h ' 9h - resolu « on HDTV signa. can be co- 
oled h r ° UtPUt 33 ° f an arithmetic "nit 62 pro- 
duced by adding an output a1 of an (OCT circuit 61 
and ^output a2 of a motion compensating circuit 

h a Jnr>? Uarter " reS ° IUti0n ima 9 e formi "9 unit 103 
has a OCT circuit 111 to process the 8*8 pixel data a2 

DcTaII^ m ° ti0n C ° mPenSati " 9 ^ « Z 
DCT. A selecting circuit 112 selects 4.4 DCT coeffi- 
cients , n the upper left-hand corner among 8*8 DCT 
coeff, c ,en»s provided by the DCTcircuit 111 removes 

he S 7" 10 a " ,DCT circuit 11 3- Thus, 
he DCT coeff.c.ents corresponding to 4*4 pixel data 

T D S d j7 9e data) produced b na " C 

T reSP6Ct t0 the va ^ical direction 

IDCT cL ^ C 31 direCti ° n Ca " be obtain *<- The 
IDCT circuit 113 processesthe input 4.4 DCTcoeffi- 
cents for IDCT to give 4.4 pixel data a5 as preyed 
image data to an arithmetic unit 1 20 

The output of a quantizing circuit 57 included in 
he full-resolution encoding unit 101 is given to a s2 
ecting circuit 117 included in the quaere o, I£ 
mage forming unit 103. The selecting circuit 117 ex 
tracts the 4.4 pixel data (low-frequency components) 
m the upper left-hand portion among 8*8 pfxe. data 
o produce the 4-4 pixel data (difference da^ by half 
thmnmg , out the 8-8 pixel data with respec 0 th e 
vert,cal d,ect,on and the horizontal direction. The Z 
invlp l ' S Pr0C8SSed f ° r inVerSe "Nation by an 
es 9 ( ' Q) drCUit 118 10 ° btain re P^n- 

Z I nrt representatives processed for IDCT 
by an IDCT c.rcu.t 119 to obtain 4.4 pixel data a4 (dif- 
ference data). The arithmetic unit 120 adds the 4 4 

of the IDCT c.rcu.t 113 to produce data a6, which is 

Fig. 2 shows the fundamental configuration of 
the decoder which decodes the HD bit stream provid- 
ed by the encoder shown in Fig. 1 to obtain hiah 
resolution HDTV sianals an n „ . 9 
SDTV signals. 9 " auarter - resol ^on 

unitl^ e l e H 0d8rCOmPn ' SeSaful| - resolutiondec ^ing 
unit 131 and a quarter-resolution image decoding unit 
133. Basically, the full-resolution decoding unit 131 is 
n ^ea S the configuration of the decoder 9 shown 
ex Jnnl Zi I " 9 hi9h - resol "h'on HDTV signals, 
except that the decoder shown in Fig. 2 is not provid- 
ed with the converting circuits 77 and 78 

An IDCT circuit 73 included in the full-resolution 
decoding unit 131 provides difference block data b1 

encJ l P l*l • Wh,Ch are the same as tn « differ- 
bv tL nrr 13 V' **" the 8 * 8 data, provided 
uni 10 a 61 ° f the fu «- r ^^on encoding 

"mt 101. A mot,on compensating circuit 76 provides 
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8*8 pixel data b2 of a predicted image, which are the 
same as the 8*8 pixel data a2 provided by the motion 
compensating circuit 64 of the full- resolution encod- 
ing unit 101 shown in Fig. 1 . Accordingly, the decoded 
data a3 obtained by adding the difference data b1 and 
the predicted image data b2 by the arithmetic unit 74 
is the same as the decoded data a3 provided by the 
arithmetic unit 62 of the full-resolution image encod- 
ing unit 101 shown in Fig. 1; that is, the decoded data 
b3 represents HDTV signals. 

A selecting circuit 82 included in the quarter-re- 
solution image decoding unit 133 selects the 4*4 dif- 
ference data (low-frequency components) included in 
the upper left-hand portion among the 8*8 difference 
data provided by the inverse quantizing circuit 72 of 
the full-resolution decoding unit 131 and gives the 
same to an IDCT circuit 83. Thus, 4*4 DCT coeffi- 
cients corresponding to the 4*4 pixel data (difference 
data) produced by half thinning out the 8*8 pixel data 
with respect to the vertical direction and the horizon- 
tal direction are obtained. The IDCT circuit 83 proc- 
esses the 4*4 pixel data for IDCT to give 4*4 differ- 
ence pixel data b4 to an arithmetic unit 84. 

A DCT circuit 91 included in the quarter-resolu- 
tion image decoding unit 133 processes the 8*8 pre- 
dicted image data provided by the motion compensat- 
ing circuit 76 for DCT to obtain 8*8 DCT coefficients. 
A selecting circuit 92 selects 4*4 DCT coefficients in- 
cluded in the uportion (low- frequency components) 
among the 8*8 DCT coefficients provided by the DCT 
circuit 91 and gives the selected DCT coefficients to 
an IDCT circuit 93. Thus, 4*4 DCT coefficients corre- 
sponding to the 4*4 pixel data (predicted image data) 
produced by half thinning out the 8*8 pixel data with 
respect to the vertical direction and the horizontal di- 
rection can be obtained. The IDCT circuit 93 process- 
es the 4*4 DCT coefficients for IDCT to give 4*4 pre- 
dicted image data b5 to the arithmetic unit 84. 

The difference data b4 provided by the IDCT cir- 
cuit 83 is the same as the difference data a4 provided 
by the IDCT circuit 119 of the encoder shown in Fig. 
1. and the predicted image data b5 provided by the 
IDCT circuit 93 is the same as the predicted image 
data a5 provided by the IDCT circuit 113 of the encod- 
er shown in Fig. 1 , consequently, decoded data b6 ob- 
tained by adding the data b4 and b5 by the arithmetic 
unit 84 is the same as the decoded data a6 provided 
by the arithmetic unit 120 of the encoder shown in 
Fig. 1. Therefore, the quarter-resolution SDTV sig- 
nals provided by the arithmetic unit 84 does not con- 
tain any mismatching errors. 

However, the decoder having the configuration 
as shown in Fig. 2 needs the full-resolution decoding 
unit 131 to decode the HDTV signals even when de- 
coded HDTV signals are unnecessary, which makes 
the circuit configuration complex, increases the scale 
of the image signal coder and the image signal decod- 
er and increases the cost of the same. A decoder in 



a preferred embodiment is a compact, low-cost de- 
coder capable of decoding only the quarter-resolution 
SDTV signals and, when necessary, of decoding 
high-resolution HDTV signals. 
5 Referring to Fig. 3, the encoder embodying the 

present invention comprises a full-resolution encod- 
ing unit 101 and a quarter-resolution mismatching er- 
ror correcting encoding unit 102. The full-resolution 
encoding unit 101 is the same in configuration as the 
10 full-resolution encoding unit 101 shown in Fig. 1. Ac- 
cordingly, the respective output data d, c2 and c3 of 
an IDCT circuit 61 , a motion compensating circuit 64 
and an arithmetic unit 62 included in the full- 
resolution encoding unit 101 of the encoder shown in 
15 Fig. 3 are equal respectively to the respective output 
data al, a2 and a3 of the IDCT circuit 61, the motion 
compensating circuit 64 and the arithmetic unit 62 of 
the full-resolution encoding unit 101 of the encoder 
shown in Fig. 1. 
20 The quarter-resolution mismatching error cor- 

recting encoding unit 103 comprises, similarly to the 
quarter-resolution image forming unit 103 of the en- 
coder shown in Fig. 1, a DCT circuit 111. a selecting 
circuit 1 1 2, an IDCT circuit 1 1 3, a selecting circuit 1 1 7, 
25 an inverse quantizing circuit 118, an IDCT circuit 119 
and an arithmetic unit 120. The output data c8 of the 
IDCT circuit 113 is equal to the output data a5 of the 
IDCT circuit 113 of the encoder shown in Fig. 1, and 
the output data c4 of the IDCT circuit 119 is equal to 
30 the output data a4 of the IDCT circuit 119 of the en- 
coder shown in Fig. 1. 

This embodiment is provided with a quarter-reso- 
lution frame memory 121 to store the output data of 
the arithmetic unit 120. A motion compensating circuit 
35 122 processes the data stored in the quarter-resolu- 
tion frame memory 121 for motion compensation and 
the output of the motion compensating circuit 1 22 is 
given to an arithmetic units 114 and 124. The arith- 
metic unit 114 subtracts predicted image data c7 pro- 
40 vided by the motion compensating circuit 122 from 
predicted image data c8 provided by the IDCT circuit 
113 to obtain difference data c9 (mismatching error 
data) representing the differences between 4*4 pre- 
dicted image data included in a predetermined por- 
45 tion of the predicted image data produced from a high- 
resolution (full-resolution) data stored in a full- 
resolution frame memory 63 and 4*4 predicted image 
data produced by processing quarter-resolution data 
stored in a quarter-resolution frame memory, i.e., 
so quarter-resolution data decoded by using a motion 
vector provided by a scaling circuit 123. 

The data c9 (= c8 - c7 = a5 - c7) is transferred 
through a switch 115 to a variable-length coding cir- 
cuit 116, and the coded data c9, i.e., a difference bit 
55 stream (8*8 - 4*4) is transmitted to the decoder. The 
data c9 is given also to an arithmetic unit 1 24. The ar- 
ithmetic unit 124 adds the predicted image data c7 
provided by the motion compensating circuit 122 and 
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the mismatching error data c9 to give data c5 (= c7 + 
c9 = c7 + a5 - c7 = a5) to the arithmetic unit 120. The 
data c5 is equal to the output data c5 of the IDCT cir- 
cuit 113. 

The arithmetic unit 120 adds the output predicted s 
image data c5 (= a5) of the arithmetic unit 1 24 and the 
output difference data c4 (= a4) of the IDCT circuit 119 
to produce quarter-resolution locally decoded data c6 
(= c4 + c5 = a4 + a5 = a6). The data c6 is stored in 
the quarter-resolution frame memory 121. 10 

The scaling circuit 123 scales down a motion vec- 
tor provided by a motion vector detecting circuit 50 by 
half with respect to both the vertical direction and the 
horizontal direction and gives the scaled-down mo- 
tion vector to the motion compensating circuit 122 for 15 
use for motion compensation when producing the pre- 
dicted image data c7. 

Although the output data c5 (= a5) of the arith- 
metic unit 1 24 is given to the arithmetic unit 120 in the 
encoder shown in Fig. 3, the output data c8 (= a5) of 20 
the IDCT circuit 113 may be given to the arithmetic 
unit 120. In the latter case, the arithmetic unit 124 
may be omitted. 

The switch 115 controls the amount of informa- 
tion represented by the mismatching error data c9 to 25 
be transmitted. Although an image having less errors 
can be decoded and a picture of higher quality can be 
formed when all the mismatching error data c9 is 
transmitted to the decoder, the transmission of all the 
mismatching error data c9 is incompatible with the ef- 30 
ficient use of the transmission line. Therefore, the 
switch 115 is closed and opened properly to control 
the amount of the mismatching error data c9 to be 
transmitted. 

For example, when transmitting P pictures, the 35 
switch 115 is closed every N P pictures. When N is in- 
creased, the amount of transmitted information de- 
creases accordingly. However, if N is excessively 
large, any difference bit stream is not virtually trans- 
mitted and drift is liable to appear on the screen. 40 
When N is reduced, the mismatching error can be re- 
set every time the switch 115 is closed and drift can 
be suppressed. However, transmission efficiency is 
reduced as the N is reduced. The value of N is deter- 
mined properly from the practical point of view. 45 

The switch 1 1 5 is opened when transmitting B pic- 
tures because mismatching errors are produced 
scarcely in B pictures. Since motion compensation is 
not performed when transmitting I pictures, the oper- 
ation of the switch 115 is ignored. 50 

Fig. 4 shows a decoder embodying the present 
invention for decoding a HD bit stream and a differ- 
ence bit stream encoded and transmitted by the en- 
coder shown in Fig. 3. The decoder comprises a full- 
resolution decoding unit 1 31 and a quarter-resolution 55 
mismatching error correcting decoding unit 132. The 
configuration of the full-resolution decoding unit 131 
is the same as that f the full-resolution decoding unit 
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131 of the decoder shown in Fig. 2 and hence the de- 
scription thereof will be omitted. The full-resolution 
decoding unit 131 is necessary only when high- 
resolution HDTV signals are required. When only 
SDTV signals are required, the full-resolution decod- 
ing unit 131 may be omitted. 

A HD bit stream is applied to a variable-length de- 
coding circuit 141 included in the quarter-resolution 
mismatching error correcting decoding unit 132. The 
variable-length decoding circuit 141 processes the 
HD bit stream for variable-length decoding, and gives 
decoded data and a quantizing scale to an inverse 
quantizing circuit 142. The inverse quantizing circuit 
1 42 processes the input data for inverse quantization 
by using the quantizing scale to obtain representa- 
tives and gives the representatives to a selecting cir- 
cuit 82. The selecting circuit 82 selects 4*4 data in the 
upper left-hand portion (low-frequency components) 
among the 8*8 data and gives the same to an IDCT 
ctrcuit 83. The IDCT circuit 83 processes the 4*4 data 
for IDCT to give difference data d4 to an arithmetic 
unit 84. 

A variable-length decoding circuit 151 processes 
the difference bit stream for variable-length decoding 
to give mismatching error data d9 (= a5 - c7) to an ar- 
ithmetic unit 152. Data d7 (= c7) obtained by motion- 
compensating data stored in a quarter-resolution 
frame memory 85 by a motion compensating circuit 
86 is given to the arithmetic unit 152. A prediction 
mode signal representing a prediction mode provided 
by the variable-length decoding circuit 141 is given to 
the motion compensating circuit 86, and a half motion 
vector obtained by scaling down the motion vector 
provided by the variable-length decoding circuit 141 
by half with respect to the vertical direction and the 
horizontal direction by a scaling circuit 87 is given to 
the motion compensating circuit 86. 

The arithmetic unit 152adds the output predicted 
image data d9 of the variable-length decoding circuit 
151 and the output mismatching error data d9 of the 
motion compensating circuit 86 to correct the mis- 
matching errors and provides corrected predicted im- 
age data d5 (= a5 - c7 + c7 = a5). The output data d5 
of the arithmetic unit 152 is equal to the output data 
a5 of the IDCT circuit 1 1 3 of the encoder shown in Fig. 
1 . which cancels out mismatching errors. Accordingly, 
decoded data d6 (= a5 + a4 = a6) obtained by adding 
the output difference data d4 (= a4) by the IDCT cir- 
cuit 83 and the output predicted image data d5 (= a5) 
of the arithmetic unit 152 by the arithmetic unit 84 
does not contain mismatching errors, so that SDTV 
signals scarcely including noise (drift) can be ob- 
tained, then obtaining both the HDTV signals and the 
SDTV signals, the variable-length decoding circuit 
1 41 and the inverse quantizing circuit 142 of the quar- 
ter-resolution mismatching error correcting decoding 
unit 132 can be used for the functions of the variable- 
length decoding circuit 71 and the inverse quantizing 
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circuit 72 of the full-resolution decoding unit 131. 

Fig. 5 shows an encoder in a second embodiment 
according to the present invention. The encoder in 
the second embodiment calculates DCT coefficients 
instead of calculating the mismatching errors in a 5 
space as pixel data, which is done by the encoder 
shown in Fig. 3. Accordingly, in the encoder shown in 
Fig. 5, an arithmetic unit 114 subtracts 4*4 DCT coef- 
ficients Coeff(e7) produced through the DCT of pre- 
dicted image data e7 provided by a motion compen- 10 
sating circuit 122 by a DCT circuit 1 64 from 4//*4 DCT 
coefficients Coeff(a5) selected among the output of 
a DCT circuit 111 by a selecting circuit 112 to provide 
data e8 (= Coeff(a5) - Coeff(a7)). 

The mismatching error signals is quantized by a 15 
quantizing circuit 161, and the output signal of the 
quantizing circuit 161 is coded by a variable-length 
coding circuit 116 to provide difference bit stream. 
The amount of information transmitted in the differ- 
ence bit stream can be regulated by controlling the 20 
quantizing characteristics of the quantizing circuit 
161. 

The mismatching error data provided by the 
quantizing circuit 161 is processed for inverse quan- 
tization to obtain representatives, the representatives 25 
are processed for IDCT by an IDCT circuit 163 to ob- 
tain reproduced values (decoded values Rec(a5 - e7) 
and the reproduced values Rec(a5 - e7) are given to 
an arithmetic unit 124. Then, the arithmetic unit 124 
provides data e5 (= Rec(a5 - el) + a7). An arithmetic 30 
unit 120 adds the mismatching error data and predic- 
tion errors provided by the motion compensating cir- 
cuit 1 22 to eliminate mismatching errors and provides 
data e6 (= Rec(a5 - e7) + a7 + a4). 

The encoder in the second embodiment is the 35 
same in other respects and in functions as the encod- 
er in the first embodiment shown in Fig. 3. 

Fig. 6 shows a decoder embodying the present 
invention for decoding the data provided by the en- 
coder shown in Fig. 5. Although the decoder shown 40 
in Fig. 6 is the same in basic configuration as the de- 
coder shown in Fig. 4, in the decoder shown in Fig. 6, 
a difference bit stream (mismatching errors) is decod- 
ed by a variable-length decoding circuit 151 and the 
decoded difference bit stream is processed for in- 45 
verse quantization by an inverse quantizing circuit 
461 to obtain representatives. An IDCT circuit 462 
processes the representatives provided by the in- 
verse quantizing circuit 461 for IDCT and gives output 
data f9 (= Rec(a5 - e7)) to an arithmetic unit 1 52. The 50 
arithmetic unit 1 52 adds the output data of the IDCT 
circuit 462 and predicted image data f7 (= c7) provid- 
ed by a motion compensating circuit 86 to cancel the 
mismatching errors and provides predicted image 
data f5 (= Rec(a5 - e7) + f7). 55 

An arithmetic unit 84adds the predicted image 
data f5 provided by the arithmetic unit 152 and differ- 
ence data f4 (= a4) provided by an IDCT circuit 83 and 



provides 4*4 pixel data (decoded image data) f6 (= 
Rec(a5 - e7) + f7 + a4 = e6). 

The locally decoded data e6 provided by the ar- 
ithmetic unit 120 of the encoder shown in Fig. 5 and 
the decoded data f6 provided by the arithmetic unit 84 
of the decoder shown in Fig. 6 are somewhat different 
from the data a6 provided by the arithmetic unit 120 
of the encoder shown in Fig. 1. However, the the data 
e6 (= f6) provided by the arithmetic unit 1 20 of the en- 
coder shown in Fig. 5 is equal to the data f6 (=e6) pro- 
vided by the arithmetic unit 84 of the decoder shown 
in Fig. 6, and there is no mismatching error between 
the data e6 and f6, that is, the the predicted image 
provided by the encoder and the predicted image pro- 
vided by trie decoder matches always each other and 
errors are not accumulated. 

Fig. 7 shows an encoder in a third embodiment 
according to the present invention. This encoder is 
provided, in addition to a full-resolution encoding unit 
101 and a quarter-resolution mismatching error cor- 
recting encoding unit 102, which are the same in con- 
figuration and function as those included in the en- 
coder shown in Fig. 5, with a sixteenth-resolution mis- 
matching error correcting encoding unit 171. 

Basically, the configuration of the sixteenth-re- 
solution mismatching error correcting encoding unit 
1 71 is the same as that of the quarter-resolution mis- 
matching error correcting encoding unit 102, except 
that the sixteenth-resolution mismatching error cor- 
recting encoding unit 171 is provided with an extract- 
ing circuit 188 which separates 2*2 data included in 
the upper left-hand portion (low-frequency compo- 
nents) from 8*8 data provided by a quantizing circuit 
57 included in the full-resolution encoding unit 101 to 
obtain DCT coefficients corresponding to 2*2 pixel 
data produced by thinning out the 8*8 pixel data to 
1/4 with respect to the vertical direction and the hor- 
izontal direction. The data provided by the extracting 
circuit 188 is processed for inverse quantization by an 
inverse quantizing circuit 189 to obtain representa- 
tives, the representatives are processed for IDCT by 
an IDCT circuit 199 to obtain difference data, and the 
difference data is give to an arithmetic unit 200. 

A selecting circuit 181 selects 2*2 DCT coeffi- 
cients included in the upper left-hand portion among 
8*8 DCT factors of predicted image data provided by 
a DCT circuit 111 included in the quarter-resolution 
mismatching error correcting encoding unit 102. and 
gives the selected 2*2 DCT coefficients to an arith- 
metic unit 1 82. Thus, DCT coefficients corresponding 
to 2*2 predicted image data produced by thinning out 
the 8*8 predicted image data to 1/4 with respect to 
the vertical direction and the horizontal direction are 
obtained. Also given to the arithmetic unit 1 82 are 2*2 
DCT coefficients obtained by processing data stored 
in a sixteenth-resolution frame memory 201 for mo- 
tion compensation by a motion compensating circuit 
202 and processing the output of the motion compen- 
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sating arcuit 202 for OCT by a OCT circuit 203. The 
anthmetic unit 182 subtracts the output of the DCT 
circuit 203 from the output of the selecting circuit 181 

m,SmatChin 9 er ™ Canals. A quantizing 
circuit 183 quantizes the mismatching error signals s 
a variable-length coding circuit 184 encodes the out- 
put of the quantizing circuit 183 to provide a differ- 
ence bit stream (8*8 - 2«2). 

The output of the quantizing circuit 183 is proc- 
essed for mverse quantization by an inverse quantiz- to 
mg circuit 185 to obtain representatives, the repre- 

1 T T, Pr ° CeSSed f0f IDCT by an ,DCT ^rouit 
186. and the output of the IDCT circuit 186 is given 

o an arithmetic unit 1 87. The arithmetic unit 1 87 adds 

comnlncT' 01 * ima9e d3ta Pr0Vlded bv the ™«°n » 
compensating circuit 202 and the 2-2 mismatching 

error data provided by the IDCT circuit 186 to correct 
the mismatching errors in the predicted image data 
and gives the corrected predicted image data to the 
arithmetic unit 200. 8 

«* t J he "J'iT eti ° 200 adds the 2 ' 2 difference '° 
dataprovided bythe IDCT circuit199 and the correct- 
ed 2*2 predicted image data provided by the arith- 
T InJ Pr ° Vide ,0Ca " y deCOded si «e«nth- 

unit 200 is stored in the sixteenth-resolution frame 
memory 201. A motion vector obtained by scaling 
down a motion vector provided by a motion vector de- 
ron 2 9 wTh U I t0 1/4 Wlth r6Spect t0 the verti "l direc- 

com^d 6 ° mal dir6Cti0n iS 9iven to the » 
compensating circuit 202. The motion compensate 

circuit 202functionsformotion compensation acco^ 

mg to the motion vector given thereto. 

In the third embodiment, a HD bit stream a dif- 
ference bit stream representing mismatching errors 35 
between a block of the 8*8 pixels and a block of 4.4 
pixels, and a difference bit stream (8.8 - 2*2) repre 
sent.ng mismatching errors between the block of 8.8 
pixe Is and a block of 2»2 pixels are transmitted. 

In the third embodiment, the amount of informa- 40 
Hon represented by the (8-8 - 2.2) difference bit 

cSn?? 8 re f 9 u at8d by COnlr0,,in 9 the 1 uan «*ng 
characteristics of the quantizing circuit 183 

Fig 8 shows a decoder in a third embodiment ac- 
cording to the present invention for decoding the data 4S 
transmitted by the encoder shown in Fig. 7 The 5" 
coder in the third embodiment is provided, in addition 
to a full-resolution decoding unit 131 and a quarter-re- 
solution mismatching error correcting decoding unit 

thl h ? Same confi 9 ura «°n as those of 50 

the decoder shown in Fig. 6, with a sixteenth-resolu- 
tion mismatching error correcting decoding unit 211 

In the sixteenth-resolution mismatching error 
correcting decoding unit 211. a HD bit stream is de- 
coded by a variable-length decoding circuit 221 . and 55 

i^outputdataofthe-variaWe-lengthdecodingcireuit 
221 is processed for inverse quantization by an in- 
verse quantizing circuit 222 to obtain representatives 



16 



A selecting circuit 223 separates 2.2 DCT coeffi- 

8.8 DCT coefficients provided by the inverse quan- 

nnn 9 H C ' rC t U,t , 2 ? ThUS ' ™ coefficients corre- 
sponding to 2.2 pixel data (difference data) produced 
by hmning out the 8*8 pixe. data to 1/4 with respect 
e verto direction and the horizontal direction 
are obtamed. The output data of the selecting circuit 
223 is processed for IDCT by an IDCT circuit 224, and 

lenJhH VeCt ° r pr0vided bv the variable- 

length decoding circuit 221 is scaled down to 1/4 with 
respect to the vertical direct and the horizontal 
taction by a scaling circuit 228, and the scaled-down 
motion vector is given .0 a motion compensating cir- 
11 J: , m ° t,0n com P en sating circuit 227 proc- 
esses the data stored in a sixteenth-resolution frame 
memory 226 for motion compensation according"" 
the motion vector given thereto and data representing 
a prediction mode provided by the variable-length de- 
coding ore* 221 to give a predicted image repre- 
sented by 2.2 pixel data to an arithmetic unit 229 

hua ?,* 8 ," 2 * 2) difference bit stream * decoded 
by a vanable-length decoding circuit230. and the out- 
put of the variable-length decoding circuit230 is proc- 
essed for inverse quantization by an inverse quantiz- 
ing circuit 321 to obtain representatives. The output of 

mrrl eTSe ?^ iZing CirCUit 231 is P rocess «d for 
OCT by an IDCT circuit 232 and the output of the 
IDCT circuit 232 is given to the arithmetic unit 229 
The anthmetic unit 229 adds mismatching error sig- 
nals between the 8*8 blocks provided by the IDCT 
circuit 232 and the 2.2 blocks, and the predicted im- 
age data provided by the motion compensating circuit 
227 to cancel the mismatching error signals and gives 

unit 225. The anthmetic unit 225 adds the corrected 

££!!!?h !E d3ta Pr ° Vided by the arithmetic u "it 
™? £J drfference data P r °vided by the IDCT cir- 
cuit 224 to provide sixteenth-resolution SDTV data 

The encoder shown in Fig. 7, similarly to the en- 
coder shown in Fig. 3, may substitute the quantizing 
circuits 161 and 183 by a switch, and may be the com? 
bmation of the mismatching error correcting encoding 
units shown in Figs. 3 and 5. When the encoder is so 
constructed, the decoder is constructed so as to meet 
the kind of mismatching error correcting data used by 
the encoder. 

Fig. 9 shows an encoder in a fourth embodiment 
according to the present invention. In this embodi- 
ment the output of a quantizing circuit 57 included in 
a full-resolution encoding block 101 is given through 
a selecting circuit 241 to a variable-length coding cir- 
cuit 58. The selecting circuit 241 extracts (8.8 - 4.4) 
data among the 8-8 DCT coefficient data given there- 
to excluding 4.4 data included in the upper left-hand 
portion and gives the same to the variable-length 
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coding circuit i8. The variable-length coding circuit 58 
encodes the input data to provide an 8*8 bit stream. 

A selecting circuit 242 selects 4*4 data in the up- 
per left-hand portion, i. e., the data which are not se- 
lected by the selecting circuit 241, among the 8*8 5 
data provided by the quantizing circuit 57 and gives 
the same to a variable-length coding circuit 243. The 
variable-length coding circuit 243 encodes the 4*4 
data to provide a 4*4 bit stream. 

In this embodiment, the 8*8 difference data pro- 10 
vided by the quantizing circuit 57 are blocked into the 
4*4 bit stream corresponding to the 4*4 data in the 
upper left-hand portion, and the 8*8 bit stream ex- 
cluding the former. Amotion vector provided by a mo- 
tion detecting circuit 50, a prediction mode provided 15 
by a prediction mode selecting circuit 54, and a quan- 
tizing scale provided by the quantizing circuit 57 are 
encoded by the variable-length coding circuit 58, and 
the coded data is transmitted in a 4*4 bit stream. Nat- 
urally, those data may be encoded by the variable- 20 
length coding circuit 58 and the coded data may be 
transmitted in an 8*8 bit stream. However, since the 
8*8 bit stream representing the data is not used by 
the decoder, it is preferable to transmit the 4*4 bit . 
stream. 25 

A quarter-resolution mismatching error correct- 
ing encoding unit 1 02 is the same in fundamental con- 
figuration as that of the encoder shown in Fig. 5, ex- 
cept that the quarter-resolution mismatching error 
correcting encoding unit 102 in this embodiment is 30 
not provided with the IDCT circuit 1 63. provided with 
an IDCT circuit 119 that functions also for the IDCT of 
mismatching error data provided by an inverse quan- 
tizing circuit 162, and not provided with the selecting 
circuit 117 (Fig. 5). The output of the selecting circuit 35 
242 is given to an inverse quantizing circuit 1 1 8. An ar- 
ithmetic unit 244 adds difference data provided by the 
inverse quantizing circuit 118 and mismatching errors 
provided by the inverse quantizing circuit 162, the 
IDCT circuit 1 1 9 processes the output of the arithmet- 40 
ic unit 244 for IDCT, and the output of the IDCT circuit 
119 is given to an arithmetic unit 120. The arithmetic 
unit 120, similarly to that of the encoder shown in Fig. 
5, provides corrected, locally decoded image data. 
The rest of the configuration and functions are the 45 
same as those of the encoder shown in Fig. 5. 

Fig. 10 shows a decoder in a fourth embodiment 
according to the present invention for decoding the 
data provided by the encoder shown in Fig. 9. In this 
embodiment, an 8*8 bit stream is decoded by a van- 50 
able-length decoding circuit 71 and the output of the 
variable-length decoding circuit 71 is given to an ar- 
ithmetic unit 251 . The 8*8 bit stream does not include 
4*4 data in the low-frequency region among the 8*8 
data. Therefore, data representing 4*4 data in the 55 
low-frequency region obtained by decoding a 4*4 bit 
stream by a variable-length decoding circuit 252 is 
given to the arithmetic unit 251. The arithmetic unit 



251 adds the respective outputs of the variable- 
length decoding circuits 71 and 252. Thus, the output 
of the arithmetic unit 251 represents 8*8 pixel data 
(difference data). An inverse quantizing circuit 72, an 
IDCT circuit 73, an arithmetic unit 74, a full-resolution 
frame memory 75 and a motion compensating circuit 
76 function in the above-mentioned manners for de- 
coding the output of the arithmetic unit 251 to provide 
HDTV signals. 

The motion compensating circuit 76 receives a 
motion vector and a prediction mode decoded by the 
variable-length decoding circuit 252. 

In a quarter-resolution mismatching error cor- 
recting decoding unit 132, an inverse quantizing cir- 
cuit 142 processes the 4*4 pixel data provided by the 
variable-length decoding circuit 252 for inverse quan- 
tization to obtain representatives, and the represen- 
tatives are given to an arithmetic unit 253. The differ- 
ence bit stream is decoded by a variable-length de- 
coding circuit 181, an inverse quantizing circuit 461 
processes the output of the variable-length decoding 
circuit 1 31 for inverse quantization to obtain represen- 
tatives, and the output of the inverse quantizing cir- 
cuit 461 is given to the arithmetic unit 253. The arith- 
metic unit 253 adds the difference data provided by 
the inverse quantizing circuit 142 and mismatching 
errors provided by the inverse quantizing circuit 461 
to correct mismatching errors and to provide correct- 
ed data (difference data). 

An IDCT circuit 83 processes the output of the ar- 
ithmetic unit 253 for IDCT and the output of the IDCT 
circuit 83 is given to an arithmetic unit 84. A scaling 
circuit 87 scales down a motion vector provided by the 
variable-length decoding circuit 252 to 1/2 with re- 
spect to the vertical direction and the horizontal direc- 
tion and gives a scaled-down motion vector to a mo- 
tion compensating circuit 86. The motion compensat- 
ing circuit 86 processes data stored in a quarter-reso- 
lution frame memory 8 for motion compensation ac- 
cording to the motion vector provided by the scaling 
circuit 87 and gives predicted image data to the arith- 
metic unit 84. The arithmetic unit 84 adds the differ- 
ence data provided by the IDCT circuit 83 and t he pre- 
dicted image data provided by the motion compensat- 
ing circuit 86 to provide decoded quarter-resolution 
SDTV signals. 

An encoder embodying the present invention pro- 
vided, similarly to encoder shown in Fig. 35, with a 
prediction mode switching circuit 52, a DCT mode 
switching circuit 55 and converting circuits 65 and 66, 
and a decoder provided, similarly to the decoder 
shown in Fig. 39. with converting circuits 77. 78 and 
88 will be described hereinafter. 

Fig. 1 1 shows a decoder in a fifth embodiment ac- 
cording to the present invention provided, similarly to 
the decoder shown in Fig. 39, with converting circuits 
77, 78 and 88. An encoder to be used in combination 
with this decoder is the same as the encoder shown 
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in Fig. 1 (Rg. 35). 

8.8 n ef< Tr n9 10 R ' 9 - 11 ' 3 HD bitstream presenting 
8 8 p xel data and transmitted by the encoder is ap 
P^ed to a receding buffer memory 70. The HD bit 
Tn ^H 3 T° ti0n VeCt ° r - a fra ^e/field predic- 

modeTbtl t 9> \ T /fie,d ° CT f,a 9' a P redic «°" 
mode (block type) and a quantizing scale. The decod- 
er shown m F,g. 11 is basical)y the same 
ation and function as the decoder shown in Fig 39 

Zul**!!! 011 ?" COm P ensat ''n9 circuits 76 and 86 
nduded .n the decoder shown in Fig. 11 is different 
in function from those of the decoders'hown in F^ 
n this embodiment, motion compensation is per- 
formed according to the frame/field prediction mode, 
and IT" Wee " tHe frame/fie,d P redicti °" ™de 
o^eSlT °" ** M ™ " >° 

In the embodiment shown in Fig. 11, an inverse 
quan, zing circujt 81 and a se|ectjn 9 cjrcu an ;; a rse 

change places with each other. 

,nwJ h l m ° ti0n com P ens ating' operation of the de- 

p 0 ^^ 39 Wi " be described *'th refer- 
ence to F,g. 12 to make clear the motion compensat- 
ing operation of the decoder in this embodiment 
0 *n*l? n 12( / a J sh ° vvs a Procedure forthemotion com- 
pensation of h.gh-resolution image data stored in the 
rame memory 63 of the encoder shown in Fig 35 

11 and? ToT: X J' ° f tHe d6C0der sn0 "" in Fig. 
clnl ?• ( , b) Sh ° WS 3 Pr ° Cedure tha rnotion 
compensation of pixel data stored in a frame memory 
85 included .n the decoder shown in Fig 11 

Suppose, for simplicity, that a motion vector 1 in- 
dicates only a vertical motion and indicates a vertical 
offset corresponding to one pixel on interleaved high- 
resolution screens. As shown in Fig. 12(a), a pixel mo- 
tion-compensated by a motion vector "1" relative to a 
reference pixel having a motion vector (MV) " 0" is 
shrfted down by one line to the first lower line a pixel 

tT^TT**** by 3 m ° tion Vector " 2 " ia lifted 
down by two Imes to the second lowerline. When the 
motion vector is "1.5'. the mean of the pixel on he 
-rst lower line and the pixe, on the second lower I ne 
is calculated to determine the motion-compensated 
P-xel interpolated pixel) motion-compensated byts 
mg the motion vector "1.5". 

nino Sin , C f h qUarter " reSOlUti0n data is obtaine d by thin- 
ning out the p,xels of high-resolution data to 1/2 with 
respect to the vertical direction and the horizontal 
rection pixels , on every other line in high-resolution 
odd , e ds are blocked into those of quarter-resoiution 

and h S hf , th ; Se ° f * M -™°Mon even fields 
and the blocked pixels are stored separately in a 
frame memory 85. Since a motion vector given to a 
motion compensating circuit 86 is scaled down to 1/2 

ta dii::? eCt K° VertiCa ' dir6Cti0n and the "°rizon- 
tal direction by a scaling circuit 87, the data motion- 
compensated by using the scaled-down motion vec- 
tor ,s on the first lower line (the second lower line on 



the high-resolution screen) as shown in Fig. 12(b) 

?kl fl P ' Xe S P ' d 3nd r are calculated by using 
the following expressions. 9 

° P = (3A + B)/4 

q • (A + B)/2 
r = (A + 3B)/4 
arp SlT pixe ' s u c °rresponding to the motion vector 
are determ.ned by interpolation, a pixel motion-corn 
10 P 3 r Sa : ed 3CC r ^ 10 3 ^"-solution m^n vector 
c JlT amP ' S 3 PiXe ' moti on-compensated ac- 
cording to a quarter-resolution motion vector "1 5" As 
shown in Fig. 12(b). the pixe. produced by motion 
compensation using the motion vector "1.5-Ts he 
« da a 0 an mtermedfate fje(d ca|cu(ated Qn the 

aZJZ 3n ' i6,d 3n 6Ven field - Accordingly 
a field drfference appears between the data of The 

of Sr^' 9 " , Pr0V,ded by thS 6nC0der and *e data 
20 nl!n« ? PrOV,ded by lhe decode r and, conse- 

20 quently, the interlace structure is spoiled 

™ J° t maintain lne inte r'ace structure of the quarter- 
resolution image, the DCT mode switching circuit 55 
must set the field DCT mode, that is. the mot on com! 
pe sabon must be performed so as to maintain the Z 

Stt r re Whe " the field DCT ™ d * - set 
IZTV m ° ti0n com P ens a«ng circuit 86 of the 

saZ ZtT m ? 9 - 11 C3rrieS ° Ut motion —Pen- 
fZ I T Sh0W " in Fi9S - 13 10 16 wn *n a DCT 
flag p ovided by a variable-length decoding circuit 71 
30 indicates a field DCT process. 

h* J?" ? Sh ° WS 3 m0ti0 " cor "Pensation process to 
cuit 7 7' °h Whe " variable -'ength decoding cir! 

35 on mod! '! Pr0Vided PiXel ' U - When tbe Predic- 
35 bon mode switching circuit 52 sets a prediction mode 

The motion compensating operations of the frame 
TeZTh 5 3nd H the m ° ti0n —P—ting circJ 3 " 
1Z I™?" ° r thS decoder > for ™don-com- 
40 Ro 13/afJ h,9h - reso,utio " -age data shown in 
4° Fig. 13(a) are the same as those shown in Fig. 12(a) 

mir^" COmpensatin 9 operations of the frame 

SEE? ?r d ^ m0ti ° n ^P^ating circuit 86 
the decoder) for the motion compensation of the low- 

45 fZ T" data Sh ° Wn in F, '9- 1 3 < b ) a re different 
45 from those shown in Fig. 12(b). 

Jw thi ! emb0diment - a low-resolution pixel corre- 
spondmg to a high-resolution pixel b is calculated by 
usmg an expression: (3b' + z')/4. where b' is a pixel in 
an eve n f ield and z> „ , pfxe( jn ^ ^ P^n 

50 o determinmg the same by interpolation on the basis 

«1m P th 3 J" a " ° dd fi6,d and the P |xel b ' «n an even 
fie d. Therefore, the data obtained by interpolation is 
data for even fields. Thus, the field of the high! 

55 SfS ? 3nd fie ' d ° f the lo w-reso,utL 
T (PamieS) COincide with e ach other 

even f.elds) which suppresses spoiling the interlace 
structure and spoiling the natural motion of the im- 
3ge. 
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Fig. 14 shows another motion compensating op- 
eration embodying the present invention in the field 
OCT mode and the frame prediction mode. In this em- 
bodiment, pixel data is estimated by interpolation us- 
ing a pixel corresponding to a motion vector "0" for an 5 
odd field and a pixel corresponding to a motion vector 
"2". instead of estimating a pixel B in an even field 
through the motion compensation of pixel data having 
a motion hector "0" using a motion vector "1". Thus, 
the field of the data coincides with that of the corre- w 
sponding high-resolution pixel (a pixel corresponding 
to the motion vector "2") (odd fields). 

In other words, the embodiment shown in Fig. 13 
gives priority to the low-resolution reference pixel 
b* and refers to the pixel b' as a motion-compensated 15 
pixel when the low-resolution reference pixel b' cor- 
responding to the high-resolution pixel c exists. On 
the other hand, the embodiment shown in Fig. 14 
forms an interpolated pixel so that the fields coincide 
with each other even if a low-resolution pixel B exists, 20 
when the field of the low-resolution pixel B is different 
from that of the corresponding high-resolution pixel 
(pixel having a motion vector "2"), because the high- 
resolution pixel is in an odd field while the low-reso- 
lution pixel is in an even field. 25 

Fig. 1 5 shows a further motion compensating op- 
eration embodying the present invention in the field 
DCT mode and the frame prediction mode. In this em- 
bodiment, pixel data corresponding to high-resolution 
pixels is determined by interpolation in both an odd 30 
field and an even field so that the fields will coincide 
with each other. For example, a pixel in an even field 
corresponding to a motion vector "1 .5" is determined 
by weighted interpolation using pixels B and D in an 
even field. Thus, the field and position of a high- 3$ 
resolution pixel corresponding to a motion vector "3" 
correspond to those of the low-resolution pixel. A pix- 
el corresponding to a motion vector "1,25" is deter- 
mined by interpolation using pixels respectively cor- 
responding to motion sectors "1" and "1.5", so that the 40 
field and position of the high-resolution pixel data and 
those of the low-resolution pixel data coincide per- 
fectly with each other. 

Fig. 16 shows a motion compensating operation 
embodying the present invention in the field DCT 45 
mode and the field prediction mode; As shown in Fig. 
16, pixel data in an odd field is determined by inter- 
polation using another pixel data in the odd field, and 
pixel data in an even field is determined by interpola- 
tion using another pixel data in the even field. so 

Although the foregoing motion compensating op- 
eration is performed in the field DCT mode, the mo- 
tion compensating operation in the field DCT mode 
may be performed in the frame DCT mode or the con- 
ventional motion compensating operation shown in 55 
Fig. 12 may be performed. 

When the field DCT mode is set while the frame 
prediction mode and the field prediction mode are 



suitably selected by the encoder, the decoder carries 
out the foregoing motion compensating operation to 
provide quarter-resolution interlace images that 
move smoothly. 

Fig. 17 shows a decoder in a sixth embodiment 
according to the present invention. An encoder to be 
used in combination with this decoder is the same as 
that shown in Fig. 35. Basically, the decoder shown 
in Fig. 17 is the same in configuration and function as 
the decoder shown in Fig. 11, except that the opera- 
tion of a selecting circuit 82 included in this decoder 
according to a DCT flag provided by a variable-length 
decoding circuit 71 is different from that of the select- 
ing circuit 82 of the decoder shown in Fig. 11 . 

When the field DCT mode is set, the selecting cir- 
cuit 82 selects 4*4 DCT coefficients in the upper left- 
hand portion shown in Fig. 18(a) corresponding to a 
low-frequency range among 8*8 DCT coefficients 
provided by an inverse quantizing circuit 81. Conse- 
quently, the operation of the decoder shown in Fig. 1 7 
is the same as that of the decoder shown in Fig. 11. 

When the frame DCT mode is set, the selecting 
circuit 82 replaces some of the selected 4*4 pixels in 
the upper left-hand portion with some of pixels in the 
lower left-hand portion representing the interlace 
structure as shown in Fig. 18(b). Naturally, such re- 
placement is not executed actually; only the DCT 
coefficients at predetermined positions are extracted 
from the 8*8 DCT coefficients. The 4*2 DCT coeffi- 
cients in the upper left-hand portion and 4*2 DCT 
coefficients in the lower left-hand portion may be se- 
lected among the 8*8 pixels (Fig. (b-1)) ( the 4*3 DCT 
coefficients in the upper left-hand portion and 4*1 
DCT coefficients in the lower left hand portion may 
be selected (Fig. (b-2)) or the 4*2 pixels in the upper 
left-hand portion, the 3*1 pixels excluding the head 
pixel on the third line in the upper left-hand portion, 
the head pixel among the pixels on the second line 
from the bottom and the 4*1 pixels on the bottom line 
may be selected (Fig. 18(b-3)). 

As mentioned above, in the field DCT mode, the 
interlace structure can be reconstructed by forming 
the data of a frame through the collection of the data 
of fields. Therefore, the 4*4 pixels in the upper left- 
hand portion corresponding to the low-frequency 
components are extracted from the 8*8 pixels. On the 
other hand, since the data of the odd lines and those 
of the even lines are processed in a mixed condition 
as shown in Fig. 37(A) in the frame DCT mode, it is 
highly probable that the interlace structure is de- 
stroyed if the 4*4 pixels in the upper left-hand portion 
corresponding to the low-frequency region are select- 
ed among the 8*8 pixels. Accordingly, some of the 
pixels corresponding to the interlace structure, i.e., 
the pixels in the lower left-hand portion among the 
8*8 pixels, are extracted to maintain the interlace 
structure. 

The embodiment shown in Fig. 17 can be com- 
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bined with the embodiment (method using motion • 
compensation) shown in Fig. 11 . 9 

m e „f i9 a ' 19 ! h ° WS a " enCOder in 3 se venth embodi- 
ment according to the present invention A Z 

;TZT C0<1 7 Unit 101 inC ' Uded in -Oder s 
Fig 3 Z * COn ! ,9,Jrati0 ' 1 as «»• ^coder shown in 
Fig. 35. Th.s encoder is provided with a quarter-reso- 
lution .mage forming unit 103 and capable Sl^cl 

the C °ctr qUar r reS0,Uti0n SDTV *°nals. Ba Sfy 
he conf.gurat.on of the quarter-resolution image 10 
formmg unit 103 is the same as that of the quTrter 
resolution image forming unit shown in F^ 1 in t he 

F<g. 19. a selecting c.rcuit 112 selects a DCT coeffi 

n^^rs ranse a ; cordin9 to a „ 

flag prov.ded by a pred.ction mode switching circuit 

fl;ent d S6 a |e S c t Ctm9 drCUit 117 Cha " 9es the DCT ^^- 
ed bC a DCT m H a " 9e aCC ° rding 10 3 DCTf,a 9 
an inrx 8 SW,tChing Circuit 55 - The output of 

cui 261 toTn h " 9iVSn thr ° U9h 3 * » 

«n nr! ar,thme tic ""it 120. and the output of 

cui 2 62 > tnT 11 ! iS 9iVSn thr ° U9h a conver "ng «£ 
cu.t 262 to the arithmetic unit 120 

When the field prediction mode is set. the select- 
or Sand" T ^ ° CT In «S£ ,5 
per left-hand portion among 8*8 DCT co^fir^o 

provided by a DCT circuit 11 land sendlthe sSd 
4.4 DCTcoefficients to an IDCT circuit 1 1 3 VVhen the 

r c ;7hf Dc n T mod rr is set - the se,ectin9 £E5 

Ra , coeff,cients 'n a manner shown in 30 

ects 4.2 DCT coeff, cents in the upper left-hand oor 
t-on , and 4*2 DCT coefficients in the lower eft hand 
portion and sends the selected DCT coefficient to 
the ,DCT circuit 113. The ,DCT circuit 35 

he input data for .DCT and gives the processed data 

26 1 l£HT 9 CirCUit 261 - The conver «"g circu 3 
261 sim ,larly to a converting circuit 66, rearranges 

i0 nr d tdata ^ 

JZeTc d u e niM20 9,VeS rearran " d - * ** <• 

cui, ^ n 'I* f i6,d DCTm ° de is set - the Electing cir- 

lef hand^f ^ ^ C ° effiCientS h the u PP* r 
left-hand port.on among the 8.8 DCT coefficients 

prov.ded by a quantizing circuit 57 and gWes The « 

rame DcTmoT* qUantte,n9 118 - S " ^ 

S the DCT >„ I 3 36 ' Se ' eCting Circuit 117 
S 1h . f,C,emS ' n 3 manner sh °wn in Fig 

iSH a ' S T h ndS Same t0 thS inveree «"9 
circu.t 118. The inversely quantized data provided by so 

DCT by the IDCT circuit 119. and the output of the 
IDCT c,rcu.t 119 is given to a converting cLit 262 

of the S" 9 C,rCUit 262 fearrangeS th « S 
Sme DCT nT"" I'' " a " arra " a ^ent for the 55 
frame DCT mode and gives the rearranged data to 
the arrtnmet "= ""it 120. The arithmetic unit 120 adds 
the respective outputs of the converting circuits 26 
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and 262 to provide decoded SDTV signals 

menr? C rn°H Sh °r S ? deC ° d6r in a seventh embodi- 
ment according to the present invention for decoding 
data encoded by the encoder shown in Fig. 19 This 

un. e 3 r i ,S t rr ded W ' th 3 fu,l -°^on 9 decoding 
resolution h? T 6 confiaura «°n as the full 
resolution decoding unit 131 shown in Fig. 11 B asi- 
caHy a quarter-resolution image decoding unit iS of 

hown "f" 2 i h6 h Same i0 COnfi9Ura ' 0n 
snown .n F,g. 2. In the quarter-resolution image de- 
coding un.t 1 33 of this decoder, a converting St 88 
<s interposed between an IDCT circuit rT!!!? • 
ithmetic unit 84 to rearranoe thl h17 " 3r " 

inrT r.;„ rZ . rear range the data provided by the 

he 1 *l f ° r the frame DCT m °de and to give 
the rearranged data to the arithmetic unit 84 The ar 
-thmet.0 unit 81 adds the respective outputs of the 
converting circuit 88 and a converting circu 271 to 
prov.de decoded SDTV signals. 

Fig. 21 shows an encoder in an eighth embodi 

ment according to the present invention , *5 Ta 
comb inati Qf the encodefs ghown . which , a 

cod ;Tt n s encodin9 unit 101 indud ' d in 

7 3me confi 9uration as the full- 

resolution encoding unit 101 of the encoder shown In 

ror,ff t SiCa " y ' 3 quarter - r esolution mismatching error 

.?thTsZ encodi ^ 9 unit 102 inc,uded in ™* 

mi^T C ° nf ' 9Urati ° n as tne carter-resolution 
m-smatchmg error correcting encoding unit 102 

112 ZH l 9 \ 3 thiS enCOder ' a se,ec «n9 circurt 
12 h s.m,larly to the selecting circuit 112 of the encod- 
er shown ,n F,g. 1 9> changes the data to be selected 

*™ n J> '** of a DCT circuit 111 accor ng 

crcu t 112 is processed for IDCT by an IDCT circuft 
113 the output of the |DCT cjrcu rcu,t 

na " arrangementf ° rthe frame Miction mode, and 
the pranged data is given to an arithmetic unit 114 
A see ing crcuit 117. similarly to the selecting circuit 

amonl „ ^ ,n Fig " 19 ' elects data 

among those provided by a quantizing circuit 57 ac- 
cordmg to the set DCT mode and give's the same to 
an .nverse quantizing circuit 118. The inversely cuan- 
zed data provided by the inverse quantizing cirouit 
118 ,s processed for IDCT by an IDCT circuit 119 a 

the ^ct 9 C,rCUit 262 rearranges the ^ ^ta of 
the IDCT crcuit 119 in the same arrangement as the 
arrangement of the output data of a motion compel 
sating circuit 122. and the rearranged data is given 0 
an arithmetic unit 120. 

unit \VoH emb0diment ' the output of the arithmetic 

c dino t ^ t r rra " 96d by 3 COnVerti "9 circ "^ 281 ac- 
cording o the set prediction mode in an arrangement 

mil h , PrediCti ° n m0de < the fiel « Prediction 

ory 21). and the rearranged data is stored in the 
quarter-resolution frame memory 121 

F-g. 22 shows a decoderin an eighth embodiment 
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according to the present invention for decoding data 
encoded by the encoder shown in Fig. 21 . This decod- 
er is a combination of the decoders shown in Figs. 4 
and 17. A full-resolution decoding unit 131 included in 
this decoder is the same in configuration as that of 5 
the decoder shown in Fig. 1 7. Basically, a quarter-re- 
solution mismatching error correcting decoding unit 
132 included in this decoder is the same in configur- 
ation as that of the decoder shown in Fig. 4. This 
quarter-resolution mismatching error correcting de- 10 
coding unit 132, similarly to that shown in Fig. 17, has 
converting circuits 88 and 89 connected respectively 
to the input and output of an arithmetic unit 84 for op- 
eration according to a prediction mode and a DCT 
mode. A selecting circuit 82 selects data according to 15 
a DCT flag in a manner similar to that previously ex- 
plained with reference to Fig. 17. 

Fig. 23 shows an encoder in a ninth embodiment 
according to the present invention. This encoder, sim- 
ilarly to the encoder shown in Fig. 5 formed by sub- 20 
stituting the switch 115 of the encoder shown in Fig. 
3 by the quantizing circuit 161, is provided with a 
quantizing circuit 161 substituting the switch 115 of 
the encoder shown in Fig. 21 . The encoder in this em- 
bodiment, similarly to the encoder shown in Fig. 5, 25 
processes the output of the quantizing circuit 161 for 
inverse quantization by an inverse quantizing circuit 
162, and processes the output of the inverse quantiz- 
ing circuit 1 62 for IDCT by an IDCT circuit 1 63. A con- 
verting circuit 301 rearranges the output of the IDCT 30 
circuit 163 according to a prediction mode flag in the 
same arrangement as that of the data provided by a 
motion compensating circuit 122, and the rearranged 
data is given to an arithmetic unit 1 24. Therefore, the 
encoder is not provided with any converting circuit 35 
corresponding to the converting circuit 261 of the en- 
coder shown in Fig. 21 . The rest of operations of this 
encoder are the same as those of the encoder shown 
in Fig. 21. 

Fig. 24 shows a decoder in a ninth embodiment 40 
according to the present invention for decoding the 
data provided by the encoder shown in Fig. 23. This 
decoder, similarly to that shown in Fig. 6, processes 
the output of a variable-length decoding circuit 151 
shown in Fig. 22 for inverse quantization by an inverse 45 
quantizing circuit 461 and processes the output of the 
inverse quantizing circuit 461 for IDCT by an IDCT cir- 
cuit 462. The output of the IDCT circuit 462 is rear- 
ranged according to a prediction mode flag provided 
by a variable-length decoding circuit 141 in the same 50 
arrangement as that of the data provided by a motion 
compensating circuit 86, and the rearranged data is 
given to an arithmetic unit 152. The rest of operations 
of this decoder are the same as those of the decoder 
shown in Fig. 22. 55 

The data provided by the foregoing encoders is 
recorded on recording media 8. A method of fabricat- 
ing the recording media will be described hereinafter 



with reference to Figs. 2 and 26. 

As shown in Fig. 25, a film of a recording material, 
such as a photoresist, is formed over the surface of 
a substrate, such as a glass substrate, to form a re- 
cording substrate. 

Then, as shown in Fig. 26, video data produced 
through predictive coding by a video encoder 501 is 
stored temporarily in a buffer 503 and audio data pro- 
duced through coding by an audio encoder 502 is 
stored temporarily in a buffer 504. The video data and 
the audio data stored respectively in the buffers 503 • 
and 50 are multiplexed together with a synchronizing 
signal by a multiplexer (MPX) 505 to produce a com- 
posite signal. An error correcting coding circuit (ECC) 
506 adds error correcting codes to the composite sig- 
nal. A modulating circuit (MOD) 507 modulates the 
composite signal for predetermined modulation, and 
then the modulated composite signal is recorded tem- 
porarily, for example, on a magnetic tape to complete 
software. When necessary, the software is edited by 
using a premastering device 508 to produce a record- 
ing signal of a format suitable for recording the re- 
cording signal on an optical disk. 

Then, as shown in Fig. 25, a laser beam is modu- 
lated according to the recording signal and photore- 
sist film is irradiated with the modulated laser beam 
to expose the photoresist film in a pattern corre- 
sponding to the recording signal. 

The exposed recording substrate is subjected to 
a developing process to form pits in the recording 
substrate. Then, the recording substrate is subjected 
to an electroforming process or the like in which the 
pits are duplicated in the recording substrate to obtain 
a metallic master plate. The metallic master plate is 
used for forming a metallic stamper for use as a mold- 
ing die. 

A resin, such as a PM MA (poly methyl methacry- 
late resin) or a PC (polycarbonate resin), is injected 
into the molding die by, for example, an injection 
molding method and the injected resin is hardened or 
a 2P (ultraviolet-hardening photopolymer) is applied 
to the surface of the metallic stamper in a film, the 
film is irradiated with ultraviolet radiation to harden 
the film. Thus the metallic stamper is duplicated in a 
resin replica having the pits corresponding to those 
formed in the metallic stamper. 

A reflecting film is formed over the surface of the 
resin replica by an evaporation process, a sputtering 
process or a spin-coating process. 

Then, the replica is subjected to necessary proc- 
esses including forming the replica in a predeter- 
mined inside diameter and a predetermined outside 
diameter and putting two replicas together to form a 
disk. A label is attached to the disk, a hub is attached 
to the disk and the disk is put in a cartridge to com- 
plete an optical disk. 

Although the present invention has been descri- 
bed as applied to encoders employing DCT for band 
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J^ 9 ' !? PreS6nt invenlion is applicable also to 
encoders which processes input two-dimensional in> 

,nn m I Predetermine ^ transformation or block- 
>ng to encode the input two-dimensional image data 

blocking and an encoder which employs wavelet 
transformation for octave blocking 

whirl "IT P T em inVenti ° n is a PP^able to decoders 
which decode transformed and coded data or blocked 

d a ata C r d 'rr 8 We " 33 10 d6COders -hich decode - 
data obta.ned by OCT. ,n those decoders, for exam! 

Pie the quarter-resolution decoder processes data in 

a quarter poruon in the low-frequency region or sZ 

ar data among all the encoded coeff iciemdata 0 "- 

verse transformation or reconstruction 1S 

« h °Ti he PreS6nt invention has be ^n descri- 
bed as applied to encoding and decoding quarter-5e- 
so ut.on ,mage data and sixteenth-resofuL image 

11 hh 38 "' inVenti ° n iS ap P ,icab,e a 's° to en- 
coding and decoding image data of a resolution lower 20 
han the normal resolution, other than quarter reso- 
lution and sixteenth resolution, "erreso- 

e mh ^ iS ^T"' fr ° m the fors 9° ina description. 
embod, ments of the present invention enable mis^ 
matchmg errors to be coded and decoded to correct 25 
the m IS ma,ching errors and, consequently, causes o 
deteno rabn9 the quality of pictures ca'n be £ 



Claims 



30 



1. An ,mage signal coding method that subjects dif- 
ference image signals representing the differenc- 
es of input ,mage data from predicted image data 35 
to transformation or blocking to produce prede- 
termined coefficient data, and codes the prede- 

inoT^h C ,° effiCient data ' S3id ima 9 e si 9"al cod- 
ing method comprising steps of- 

f Q r ma Ho° dUCin9 firet data 5y the inverse trans- 40 
formauon or reconstruction of the coefficient 

rnfl ... extractin 9 a Predetermined portion of the 
coefficient data; 

trance 0 '! 1 ' 0 " 19 SeC ° nd d3ta b * the '"^rse 45 

transformation or reconstruction of the coeffi- 
cent data included in the predetermined portion- 
producing third data by extracting data 
Z Z^ m9 ? predetermi ned Portion from 

invV™ <J f SUb,eCtin9 the extracted da ta to 5 o 
inverse transformation or reconstruction; and 

„ Ca,culatin 9 tna differences between the 

"Cncr^^^ 

2. An image signal coding method according to * 
claim 1. wherein the transformation is the ortho- 
gonal transformation of a block of N.N pixels. 

22 



3. An image coding method according to claim 1 
wherein the transformation is wavelet transfer 
mation. 

4 ' ^iiTV' 9 " 3 ' COdin9 metnod acc °rding to 
claim 1. wherein said blocking is subband block- 

5 ' d a iiT 98 K Si9nal C ° din9 method acc ording to 
cla,m 2. wherein the orthogonal transformation is 

6 " ^ ir T, a9e K Si9na ' C ° din9 method acc °rding to 
c aim 2 wherein the predetermined portion is a 
block of n»n pixels (n = 1, 2. 3 N-1). 

7 ' 2 ai mT 9 l Si9nal C ° dinQ method acc °rding to 

cLZJ > er6,n 1 ^ 0^th090na, transformation is 
earned out ,n a field blocking mode when the pre- 
dicted .mage is formed in a field prediction mode. 

8 ' ^ i i? 9 t Si9na ' C ° din9 method acc °rding to 
S > ere,n ° rth090nal tr ansformation is 
earned out in a frame blocking mode when the 
predated ,mage is formed in a frame prediction 

9. An image signal coding method according to 
claim 1 . wherein the third data is produced by ex- 
tracting coefficient data included in the predeter- 
mined portion extracted when producing the sec- 
ond data from the first data. 

10. An image signal coding method according to 

claim 1 wherein a motion vector detected in pro- 
ducing the first data j8 ca(cu|ated by sca(e p 

formation, and the motion vector is used for the 
motion compensation of the second data. 

11. An image signal coding method according to 
claim 1, wherein the motion compensation of the 
second data is carried out in a prediction mode on 
the basis of the motion vector detected in produc- 
ing the first data. 



12. An ,mage signal coding method according to 
claim 11. wherein the motion compensation is 
produced by interpolating or extrapolating pixels 
a he same position in the same field as those 
of the pixels used for forming the first data. 

13. An image signal coding method according to 
claim 1 wherein the second data and the third 
data are formed in the field prediction mode when 
he predetermined predicted image is formed in 

the field prediction mode. 

14. An image signal coding method according to 
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claim 1, wherein the second data and the third 
data are formed in the frame prediction mode. 

15. An image signal coding method according to 
claim 5. wherein data representing an interlace 5 
structure and data representing frequencies in a 
low-frequency band among the third data are ex- 
tracted. 

16. An image signal decoding method that produces 
predetermined coefficient data by the transfor- 
mation or blocking of difference image signal rep- 
resenting the difference from a predetermined 
predicted image, transmits first data obtained by 
coding the coefficient data, produces second 
data by the inverse transformation or reconstruc- 
tion of the coefficient data, extracts the predeter- 
mined portion of the coefficient data, produces 
third data by the inverse transformation or recon- 
struction of the coefficient data included in the 
predetermined portion, extracts data corre- 
sponding to the predetermined portion from the 
second data, produces fourth data by the inverse 
transformation or reconstruction of the data ex- 
tracted from the second data, calculates the dif- 
ference between the third data and the fourth 
data, and decodes the coded difference as fifth 
data, said image signal decoding method com- 
prising: 

extracting the predetermined portion of 
the first data; 

producing sixth data by the inverse trans- 
formation or reconstruction of the data included 
in the predetermined portion; and 

adding the fifth data and the sixth data to 
decode an image corresponding to the predeter- 
mined portion. 

17. An image signal decoding method according to 
claim 16, wherein the inverse transformation is 40 
the inverse orthogonal transformation of a block 

of N-N pixels. 

18. An image signal decoding method according to 
claim 16, wherein the inverse transformation is 45 
wavelet inverse transformation. 

19. An image signal decoding method according to 
claim 16, wherein the reconstruction is subband 
reconstruction. 50 

20. An image signal decoding method according to 
claim 17, wherein the inverse transformation is 
IDCT. 

55 

21. An image signal decoding method according to 
claim 17, wherein the predetermined portion is a 
block of n*n pixels (n = 1, 2, 3 N-1). 



22. An image signal decoding method according to 
claim 16, wherein data representing an interlace 
construction and data representing low-frequen- 
cy components are extracted from the first data 
when the coefficient data is obtained in a frame 
DCT mode. 



27. An image signal decoding method according to 
claim 23, wherein motion compensation is carried 
out so that the position of the pixels of the pre- 
dicted image to be used for decoding coincides 
with that of the pixels of the predicted image used 
for coding when the prediction mode is the field 
prediction mode. 

28. An image signal decoding method comprising: 
extracting a predetermined portion of coefficient 
data produced by the frame DCT or field DCT of 
predetermined image signals; and decoding the 
coefficient data included in the extracted prede- 
termined portion of the coefficient data: 

characterized in that coefficient data rep- 
resenting low-frequency signals is selected so 
that coefficient data representing an interlace 
structure is extracted as coefficient data for de- 



23. An image signal decoding method that decodes 
coded data obtained by the transformation or 

w blocking of difference image signals representing 

the difference between a predicted image 
formed in a prediction mode on the basis of a mo- 
tion vector, and an input image, characterized in 
that a predicted image for decoding is produced 
15 by motion compensation in the prediction mode. 

24. An image signal decoding method according to 
claim 23, wherein the motion compensation is 
carried out so that the field of the pixels of the 

20 predicted image to be used for decoding coincide 

with the field of pixels of the predicted image 
used for coding when the prediction mode is the 
frame prediction mode. 

25 25. An image signal decoding method according to 
claim 23, wherein the pixels of a predicted image 
used for decoding are produced by interpolation 
when the corresponding pixels of the predicted 
image used for coding are produced by interpola- 
30 tion, when carrying out motion compensation. 

26. An image signal decoding method according to 
claim 23, wherein, when the predicted image 
used for decoding has pixels corresponding to 
35 the pixels of the predicted image used for coding 

when carrying out motion compensation, the pix- 
els corresponding to those of the predicted im- 
age used for coding are used for motion compen- 
sation. 
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Zt 9 £r n C06ff iCient data is P™*«ed by 
frame OCT, and coefficient data of low-frequency 
signals ,s selected as coefficient data for decod- 
ing when the coefficient data is produced by field 

5 

29. An image signal recording medium capable of re- 
mind lT>TT y im39e Si9nal »«*«"■ 
method stated in claim 1. 



30. An image signal encoder that produces predeter- 
mined coefficient data by the transformation or 

££d£ a mer : nce ima9e signai 

-ng the deference from a predetermined predict- 
ed ,mage and codes the coefficient data, said im- 
age signal encoder comprising: 

d ate >„ 3 f irSt mSanS f ° r sub ' e <*ng the coefficient 
data to inverse transformation or reconstruction- 
a second means for producing first data by 
the ^nobon compensation of the outputof the f irst 

min-n 3 t i W meanS f0r extra ct<ng a predeter- 
mined portion of the coefficient data; 

a fourth m eans for producing second data 
by the inverse transformation or reconstruction of 
l^ f ' Cient data "ndud«l in the predeter- 
mined portion provided by the third means- 

a fifth means for producing third data by 
extracbng data corresponding to the predeter- 
mined portion from the first data; and 

a sixth means for coding a difference sig- 
nal representing the difference between the sec- 
ond data and the third data. 

31 fu^ 396 Si9na ' encoder Wording to claim 30. 
further compnsmg: a seventh means for the mo- 
tion compensation of the second data. 

32. An image signal decoder that produces predeter- 
mined coefficient data by the transformation or 

inn 3 differenCe ima9e S *" a ' rent- 

ing the difference from a predetermined predict- 
ed image transmits first data obtained by coding 
he coeff,c,ent data, produces second data by 
he inverse transformation or reconstruction of 
ooruT^T data ' 6XtraCtS 3 Predetermined 
; COeffidem data - praduc es third 
date by the inverse transformation or reconstruc- 
tion of the coefficient data included in the prede- 
fined portion, extracts data corresponding to 
the predetermined portion from the second data 
produces fourth data by the inverse transform* 
t-on or reconstruction of the extracted data, cal- 
culates the difference between the third data and 
the fourth data, and decodes fifth data obtained 
by coding the difference, said image signal de- 
coder comprising: 

a first decoding means for decoding data 



10 



inched in the predetermined portion among the 

an image reproducing means forreproduc- 
'"I 396 ^responding to the predeter- 
mined portion on the basis of the respective out- 
puts of the first decoding means and the seco 
decoding means. 

33. An image signal decoder according to claim 32 
wherein said image reproducing means has a 
mobon compensabng means for motion compen- 
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r = (3D + A)/4 
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C 1/4 RESOLUTION PREDICTED PIXEL 

q = (3D + B)/4 
s = (A + C)/2 

p = (A + q)/2= (4A + B + 3D)/8 
r = (c; + s)/2=(2A-f B + 2C + 3D)/4 
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